2021-01-27T13:14:51.678 INFO:root:teuthology version: 1.0.0-fe79ba1b 2021-01-27T13:14:51.680 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5833345 --description rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} --lock --block --name kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi --verbose -- /tmp/teuthology-worker.nuscs6z7.tmp 2021-01-27T13:14:51.705 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T13:14:51.780 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5833345 branch: wip-kefu-testing-2021-01-27-1353 description: rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} email: tchaikov@gmail.com first_in_suite: false job_id: '5833345' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-kefu-testing-2021-01-27-1353 ceph: conf: global: mon election default strategy: 1 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(PG_ - \(OSD_ - \(OBJECT_ - \(POOL_APP_NOT_ENABLED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 507028cb839c25d6666833702df6325fd8569096 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: root install: ceph: sha1: 507028cb839c25d6666833702df6325fd8569096 workunit: branch: wip-kefu-testing-2021-01-27-1353 sha1: 507028cb839c25d6666833702df6325fd8569096 owner: scheduled_kchai@teuthology priority: 80 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.realm.zone.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 507028cb839c25d6666833702df6325fd8569096 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2021-01-27-1353 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 507028cb839c25d6666833702df6325fd8569096 tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test_python.sh teuthology_branch: master timestamp: 2021-01-27_08:19:23 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.6142 2021-01-27T13:14:51.781 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa; will attempt to use it 2021-01-27T13:14:51.781 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa/tasks 2021-01-27T13:14:51.782 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-01-27T13:14:51.784 INFO:teuthology.task.internal:Checking packages... 2021-01-27T13:14:51.804 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '507028cb839c25d6666833702df6325fd8569096' 2021-01-27T13:14:51.805 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-01-27T13:14:51.805 INFO:teuthology.packaging:ref: None 2021-01-27T13:14:51.806 INFO:teuthology.packaging:tag: None 2021-01-27T13:14:51.806 INFO:teuthology.packaging:branch: wip-kefu-testing-2021-01-27-1353 2021-01-27T13:14:51.806 INFO:teuthology.packaging:sha1: 507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:14:51.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-kefu-testing-2021-01-27-1353 2021-01-27T13:14:51.972 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-184-g507028cb-1focal 2021-01-27T13:14:51.972 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-01-27T13:14:51.981 INFO:teuthology.task.internal:no buildpackages task found 2021-01-27T13:14:51.981 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-01-27T13:14:52.062 INFO:teuthology.task.internal.lock_machines:Locking machines... 2021-01-27T13:14:52.062 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T13:14:52.116 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5833345'} 2021-01-27T13:14:52.135 DEBUG:teuthology.lock.ops:locked ubuntu@smithi037.front.sepia.ceph.com, ubuntu@smithi099.front.sepia.ceph.com 2021-01-27T13:14:52.197 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e0d98fae8>, signals=[15]) 2021-01-27T13:14:52.433 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of ubuntu 20.04 2021-01-27T13:14:52.466 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 20.04 2021-01-27T13:14:52.885 INFO:teuthology.orchestra.console:Power off smithi037 2021-01-27T13:14:52.886 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-27T13:14:52.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:14:53.009 INFO:teuthology.orchestra.console:Power off smithi099 2021-01-27T13:14:53.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-27T13:14:53.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:14:56.934 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:14:57.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:01.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:01.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:01.265 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2021-01-27T13:15:01.367 INFO:teuthology.orchestra.console:Power on smithi037 2021-01-27T13:15:01.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-27T13:15:01.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:05.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:05.422 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:05.505 INFO:teuthology.orchestra.console:Power off for smithi099 completed 2021-01-27T13:15:05.607 INFO:teuthology.orchestra.console:Power on smithi099 2021-01-27T13:15:05.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-27T13:15:05.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:09.534 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:09.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:09.745 INFO:teuthology.orchestra.console:Power on for smithi037 completed 2021-01-27T13:15:09.846 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2021-01-27T13:15:13.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T13:15:14.086 INFO:teuthology.orchestra.console:Power on for smithi099 completed 2021-01-27T13:15:14.187 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2021-01-27T13:17:56.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:05.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:14.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:23.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:30.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:32.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:39.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:41.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:48.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:18:57.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:19:06.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:19:15.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:19:24.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:19:47.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:19:47.648 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-27T13:19:47.651 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-27T13:19:48.093 INFO:teuthology.provision.fog.smithi037:Node is ready 2021-01-27T13:19:48.093 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2021-01-27T13:19:48.101 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2021-01-27T13:19:48.101 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2021-01-27T13:19:48.150 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2021-01-27T13:19:48.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2021-01-27T13:19:48.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2021-01-27T13:19:48.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2021-01-27T13:19:48.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2021-01-27T13:19:48.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2021-01-27T13:19:48.341 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2021-01-27T13:19:48.343 DEBUG:teuthology.parallel:result is None 2021-01-27T13:20:02.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:08.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:14.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:20.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:26.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:26.556 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-27T13:20:26.557 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-27T13:20:27.045 INFO:teuthology.provision.fog.smithi099:Node is ready 2021-01-27T13:20:27.045 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2021-01-27T13:20:27.052 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2021-01-27T13:20:27.053 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2021-01-27T13:20:27.103 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2021-01-27T13:20:27.103 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2021-01-27T13:20:27.223 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2021-01-27T13:20:27.237 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2021-01-27T13:20:27.297 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2021-01-27T13:20:27.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2021-01-27T13:20:27.367 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2021-01-27T13:20:27.368 DEBUG:teuthology.parallel:result is None 2021-01-27T13:20:27.584 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2021-01-27T13:20:27.585 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-27T13:20:27.609 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2021-01-27T13:20:27.610 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-27T13:20:27.624 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2021-01-27T13:20:27.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:20:27.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:27.703 DEBUG:teuthology.orchestra.run.smithi037:> true 2021-01-27T13:20:27.920 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2021-01-27T13:20:27.926 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2021-01-27T13:20:27.927 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2021-01-27T13:20:27.933 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2021-01-27T13:20:27.933 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T13:20:27.934 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2021-01-27T13:20:27.934 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2021-01-27T13:20:27.934 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T13:20:27.935 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="20.04" 2021-01-27T13:20:27.935 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T13:20:27.935 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T13:20:27.936 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T13:20:27.936 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T13:20:27.936 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=focal 2021-01-27T13:20:27.936 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=focal 2021-01-27T13:20:27.938 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2021-01-27T13:20:27.955 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2021-01-27T13:20:27.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:20:27.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:28.010 DEBUG:teuthology.orchestra.run.smithi099:> true 2021-01-27T13:20:28.124 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2021-01-27T13:20:28.131 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2021-01-27T13:20:28.131 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2021-01-27T13:20:28.177 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2021-01-27T13:20:28.178 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T13:20:28.178 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2021-01-27T13:20:28.178 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2021-01-27T13:20:28.179 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T13:20:28.179 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2021-01-27T13:20:28.179 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T13:20:28.179 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T13:20:28.180 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T13:20:28.180 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T13:20:28.180 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2021-01-27T13:20:28.180 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2021-01-27T13:20:28.181 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2021-01-27T13:20:28.194 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2021-01-27T13:20:28.228 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYMgkMqLyhVL5YNCeUC43ner7ObJfY8M0iP3UrLer7aux0eIElJqT7UMLmS+RtkB26Ztz7xpx110N6IJznOhDC2ZTsbLbE80fQ8kVbgn6jAMLobhdrH+gWYOw/E9U0wBn3EMVQnB60R/chNWhyrDjeXu/jismzYoIsJSc+pccg1pH59CH7FM/O9Kr4KECGtCGm9YMmmjke2uo3H+CWb7+6fHHPBpxZ5PVv95Ho0uGS/+bqTAUfpUqWpT03dlcK0B8wbmn0w0HUTNam15rxlWNra3KUPKr0jju2hoLDE6XPdiLOkyYxl0eVTD4JUUMqV72ySqL9ckYQ7FvsBEKaJ+yE6LF23TOpDJJ8ZkASmYkO9H4CT0U+4WEDiZsUcuTwqVs5Fcg5u/cdTKywaKZTCA1we7NVwStysTqBltELCYdsKs2wJgWXlDqnqj/loLsQ+Cav/JYbPGUqtkX3jS1pXgQQmY4yWdRvt5O3O1N/X0Bee9Sn0CQhnn4D8gNTXGbqrqE= smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDUS34w1L4OnB1UQY8BJJ3Xod54VrKPUnwI0iILgLUul/44eswL18Jlp1gOxP6BkpINs6/CdsteejJ9pt0yxpm6ZJO3c/0EXYrMNofX26LgVlkiHg0vys3205QUmaH+xPWSiWHLmoPYNuDnmXTlNh/MqH3hByQOMx0nRtXxLkpoVVu48TAJyWM7cDJDvIYNzemTsLUe+dnqWx4qEwHBUXyUTklvVovp9DqCEOR4a+CmZ7PWiG4Vo6zMhLzfLadeGDK0iFFyh/fpshydxfkZKcTEKhpvYOoUlealTRH2tP8MwXbqo/H6KmGFthAJFe5ZuBzqKcfKZH876mXm+1PTuRO88acevjHlE+hO8/bHu7w2HiCjSdlM0JukAQeUgtgHNdVh/3q+IuPTRftHmfEPbGr+0sXkKMuUnbNdulx6P8+EV3qE/kTiUkOzFBGs/n8o05NsVu5a0QtxVlFKGzinnKjhYjDjh6XkBaxcifvcJ94wHssEr/LaHTcLfVWRWOvkdM= 2021-01-27T13:20:28.228 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T13:20:28.280 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-01-27T13:20:28.290 INFO:teuthology.task.internal:Saving configuration 2021-01-27T13:20:28.319 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-01-27T13:20:28.329 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-01-27T13:20:28.353 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-27 13:14:52.125198', 'description': '/home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5833345', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJyXeWfK1sJtU/wmqw6giM//2tAZycCgUPSM1DQgZCtq', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi037.front.sepia.ceph.com'} 2021-01-27T13:20:28.371 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-27 13:14:52.125218', 'description': '/home/teuthworker/archive/kchai-2021-01-27_08:19:23-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5833345', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILBlnlI3zafouSoPGTVWqNPXJiKN/tsER0WjGjw/O7Tq', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi099.front.sepia.ceph.com'} 2021-01-27T13:20:28.727 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-01-27T13:20:28.741 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.realm.zone.a', 'node-exporter.a', 'alertmanager.a'] 2021-01-27T13:20:28.742 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-01-27T13:20:28.742 INFO:teuthology.run_tasks:Running task console_log... 2021-01-27T13:20:29.129 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e0d96dbf8>, signals=[15]) 2021-01-27T13:20:29.130 INFO:teuthology.run_tasks:Running task internal.connect... 2021-01-27T13:20:29.350 INFO:teuthology.task.internal:Opening connections... 2021-01-27T13:20:29.351 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2021-01-27T13:20:29.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:29.416 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2021-01-27T13:20:29.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:20:29.458 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-01-27T13:20:29.467 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2021-01-27T13:20:29.512 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2021-01-27T13:20:29.513 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2021-01-27T13:20:29.561 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2021-01-27T13:20:29.561 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T13:20:29.562 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2021-01-27T13:20:29.562 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2021-01-27T13:20:29.562 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T13:20:29.563 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="20.04" 2021-01-27T13:20:29.563 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T13:20:29.563 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T13:20:29.564 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T13:20:29.564 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T13:20:29.564 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=focal 2021-01-27T13:20:29.565 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=focal 2021-01-27T13:20:29.565 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2021-01-27T13:20:29.582 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2021-01-27T13:20:29.586 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2021-01-27T13:20:29.586 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2021-01-27T13:20:29.637 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2021-01-27T13:20:29.637 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T13:20:29.637 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2021-01-27T13:20:29.638 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2021-01-27T13:20:29.638 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T13:20:29.638 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2021-01-27T13:20:29.638 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T13:20:29.639 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T13:20:29.639 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T13:20:29.639 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T13:20:29.639 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2021-01-27T13:20:29.639 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2021-01-27T13:20:29.640 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2021-01-27T13:20:29.653 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-01-27T13:20:29.712 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-01-27T13:20:29.747 INFO:teuthology.task.internal:Checking for old test directory... 2021-01-27T13:20:29.747 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2021-01-27T13:20:29.750 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2021-01-27T13:20:29.756 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-01-27T13:20:29.771 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-01-27T13:20:29.771 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2021-01-27T13:20:29.797 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2021-01-27T13:20:29.822 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-01-27T13:20:29.865 INFO:teuthology.run_tasks:Running task kernel... 2021-01-27T13:20:29.924 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.realm.zone.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}, 'ceph.iscsi.iscsi.a': {'kdb': True, 'sha1': 'distro'}} 2021-01-27T13:20:29.924 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-01-27T13:20:29.925 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2021-01-27T13:20:29.931 INFO:teuthology.orchestra.run.smithi037.stdout:5.4.0-64-generic 2021-01-27T13:20:29.932 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.4.0-64-generic 2021-01-27T13:20:29.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get clean 2021-01-27T13:20:30.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2021-01-27T13:20:30.442 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T13:20:30.442 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-27T13:20:30.503 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-27T13:20:30.823 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-27T13:20:30.898 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [179 kB] 2021-01-27T13:20:31.040 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-27T13:20:31.096 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [468 kB] 2021-01-27T13:20:31.196 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [102 kB] 2021-01-27T13:20:31.204 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [5,900 B] 2021-01-27T13:20:31.205 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-27T13:20:31.223 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-27T13:20:31.226 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [417 kB] 2021-01-27T13:20:31.231 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [789 kB] 2021-01-27T13:20:31.282 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [527 kB] 2021-01-27T13:20:31.318 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [71.9 kB] 2021-01-27T13:20:31.322 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,600 B] 2021-01-27T13:20:31.332 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [191 kB] 2021-01-27T13:20:31.352 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-27T13:20:31.464 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [142 kB] 2021-01-27T13:20:31.464 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.2 kB] 2021-01-27T13:20:31.464 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-27T13:20:31.464 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-27T13:20:31.465 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-27T13:20:31.465 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-27T13:20:31.465 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-27T13:20:31.465 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-27T13:20:31.488 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-27T13:20:34.406 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 5,274 kB in 2s (3,477 kB/s) 2021-01-27T13:20:35.463 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2021-01-27T13:20:35.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T13:20:35.559 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2021-01-27T13:20:35.703 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2021-01-27T13:20:35.704 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2021-01-27T13:20:35.775 INFO:teuthology.orchestra.run.smithi037.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T13:20:35.777 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T13:20:35.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T13:20:35.844 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2021-01-27T13:20:35.997 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2021-01-27T13:20:35.998 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2021-01-27T13:20:36.136 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2021-01-27T13:20:36.137 INFO:teuthology.orchestra.run.smithi037.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T13:20:36.137 INFO:teuthology.orchestra.run.smithi037.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-27T13:20:36.137 INFO:teuthology.orchestra.run.smithi037.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-27T13:20:36.138 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2021-01-27T13:20:36.138 INFO:teuthology.orchestra.run.smithi037.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-27T13:20:36.138 INFO:teuthology.orchestra.run.smithi037.stdout:Recommended packages: 2021-01-27T13:20:36.138 INFO:teuthology.orchestra.run.smithi037.stdout: thermald 2021-01-27T13:20:36.166 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2021-01-27T13:20:36.166 INFO:teuthology.orchestra.run.smithi037.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T13:20:36.167 INFO:teuthology.orchestra.run.smithi037.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-27T13:20:36.167 INFO:teuthology.orchestra.run.smithi037.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-27T13:20:36.167 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages will be upgraded: 2021-01-27T13:20:36.168 INFO:teuthology.orchestra.run.smithi037.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-27T13:20:36.343 INFO:teuthology.orchestra.run.smithi037.stdout:3 upgraded, 5 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T13:20:36.343 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 74.1 MB of archives. 2021-01-27T13:20:36.343 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-27T13:20:36.343 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-27T13:20:37.440 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-27T13:20:37.691 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-27T13:20:38.844 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-27T13:20:38.844 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-27T13:20:38.845 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-27T13:20:39.153 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-27T13:20:39.194 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-27T13:20:39.676 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 74.1 MB in 3s (24.5 MB/s) 2021-01-27T13:20:39.869 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-27T13:20:41.772 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-27T13:20:41.777 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T13:20:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:20:43.629 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-27T13:20:43.643 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T13:20:43.748 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:20:44.732 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-27T13:20:44.746 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T13:20:44.790 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:20:49.628 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T13:20:49.752 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T13:20:50.037 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T13:20:50.139 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T13:20:50.467 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-27T13:20:50.481 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-27T13:20:50.525 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T13:20:55.843 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-27T13:20:55.864 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T13:20:55.901 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:20:58.533 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T13:20:58.653 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T13:20:58.981 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T13:20:59.091 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:00.285 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:00.411 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-27T13:21:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:01.686 INFO:teuthology.orchestra.run.smithi037.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-27T13:21:01.686 INFO:teuthology.orchestra.run.smithi037.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-27T13:21:01.822 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:02.932 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-27T13:21:03.058 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-27T13:21:03.193 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:03.387 INFO:teuthology.orchestra.run.smithi037.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-27T13:21:03.388 INFO:teuthology.orchestra.run.smithi037.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-27T13:21:25.410 INFO:teuthology.orchestra.run.smithi037.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-27T13:21:25.410 INFO:teuthology.orchestra.run.smithi037.stdout:Sourcing file `/etc/default/grub' 2021-01-27T13:21:25.425 INFO:teuthology.orchestra.run.smithi037.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T13:21:25.451 INFO:teuthology.orchestra.run.smithi037.stdout:Generating grub configuration file ... 2021-01-27T13:21:25.815 INFO:teuthology.orchestra.run.smithi037.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T13:21:25.860 INFO:teuthology.orchestra.run.smithi037.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T13:21:26.248 INFO:teuthology.orchestra.run.smithi037.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T13:21:26.260 INFO:teuthology.orchestra.run.smithi037.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T13:21:28.991 INFO:teuthology.orchestra.run.smithi037.stdout:done 2021-01-27T13:21:29.339 DEBUG:teuthology.orchestra.run.smithi037:> dpkg -s linux-image-generic 2021-01-27T13:21:29.374 INFO:teuthology.orchestra.run.smithi037.stdout:Package: linux-image-generic 2021-01-27T13:21:29.374 INFO:teuthology.orchestra.run.smithi037.stdout:Status: install ok installed 2021-01-27T13:21:29.374 INFO:teuthology.orchestra.run.smithi037.stdout:Priority: optional 2021-01-27T13:21:29.375 INFO:teuthology.orchestra.run.smithi037.stdout:Section: kernel 2021-01-27T13:21:29.375 INFO:teuthology.orchestra.run.smithi037.stdout:Installed-Size: 18 2021-01-27T13:21:29.375 INFO:teuthology.orchestra.run.smithi037.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T13:21:29.375 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: amd64 2021-01-27T13:21:29.376 INFO:teuthology.orchestra.run.smithi037.stdout:Source: linux-meta 2021-01-27T13:21:29.376 INFO:teuthology.orchestra.run.smithi037.stdout:Version: 5.4.0.65.68 2021-01-27T13:21:29.376 INFO:teuthology.orchestra.run.smithi037.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T13:21:29.376 INFO:teuthology.orchestra.run.smithi037.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T13:21:29.376 INFO:teuthology.orchestra.run.smithi037.stdout:Recommends: thermald 2021-01-27T13:21:29.377 INFO:teuthology.orchestra.run.smithi037.stdout:Description: Generic Linux kernel image 2021-01-27T13:21:29.377 INFO:teuthology.orchestra.run.smithi037.stdout: This package will always depend on the latest generic kernel image 2021-01-27T13:21:29.377 INFO:teuthology.orchestra.run.smithi037.stdout: available. 2021-01-27T13:21:29.377 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-27T13:21:29.378 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2021-01-27T13:21:29.385 INFO:teuthology.orchestra.run.smithi099.stdout:5.4.0-64-generic 2021-01-27T13:21:29.386 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.4.0-64-generic 2021-01-27T13:21:29.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2021-01-27T13:21:29.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2021-01-27T13:21:29.736 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-27T13:21:29.834 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T13:21:29.912 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-27T13:21:30.055 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [468 kB] 2021-01-27T13:21:30.155 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [179 kB] 2021-01-27T13:21:30.163 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [102 kB] 2021-01-27T13:21:30.164 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [5,900 B] 2021-01-27T13:21:30.165 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-27T13:21:30.168 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-27T13:21:30.168 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [527 kB] 2021-01-27T13:21:30.191 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [417 kB] 2021-01-27T13:21:30.205 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [71.9 kB] 2021-01-27T13:21:30.206 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,600 B] 2021-01-27T13:21:30.239 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-27T13:21:30.366 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-27T13:21:30.561 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [789 kB] 2021-01-27T13:21:30.658 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [191 kB] 2021-01-27T13:21:30.676 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-27T13:21:30.677 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [142 kB] 2021-01-27T13:21:30.690 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.2 kB] 2021-01-27T13:21:30.692 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-27T13:21:30.736 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-27T13:21:30.760 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-27T13:21:30.766 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-27T13:21:30.766 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-27T13:21:30.767 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-27T13:21:30.816 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-27T13:21:33.547 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 5,274 kB in 1s (4,010 kB/s) 2021-01-27T13:21:34.624 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-01-27T13:21:34.644 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T13:21:34.706 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-01-27T13:21:34.843 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-01-27T13:21:34.844 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-01-27T13:21:34.911 INFO:teuthology.orchestra.run.smithi099.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T13:21:34.912 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T13:21:34.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T13:21:34.981 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-01-27T13:21:35.132 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-01-27T13:21:35.132 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-01-27T13:21:35.272 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2021-01-27T13:21:35.273 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T13:21:35.273 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-27T13:21:35.274 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-27T13:21:35.275 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2021-01-27T13:21:35.275 INFO:teuthology.orchestra.run.smithi099.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-27T13:21:35.275 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2021-01-27T13:21:35.276 INFO:teuthology.orchestra.run.smithi099.stdout: thermald 2021-01-27T13:21:35.305 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2021-01-27T13:21:35.306 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T13:21:35.306 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-27T13:21:35.306 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-27T13:21:35.307 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2021-01-27T13:21:35.308 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-27T13:21:35.484 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 5 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T13:21:35.485 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 74.1 MB of archives. 2021-01-27T13:21:35.485 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-27T13:21:35.485 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-27T13:21:36.586 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-27T13:21:36.834 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-27T13:21:38.068 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-27T13:21:38.068 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-27T13:21:38.069 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-27T13:21:38.334 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-27T13:21:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-27T13:21:38.848 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 74.1 MB in 3s (24.2 MB/s) 2021-01-27T13:21:39.062 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-27T13:21:41.032 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-27T13:21:41.037 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T13:21:41.115 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:42.997 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-27T13:21:43.014 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T13:21:43.128 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:44.116 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-27T13:21:44.131 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T13:21:44.174 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:48.872 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T13:21:48.994 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T13:21:49.363 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T13:21:49.498 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T13:21:49.792 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-27T13:21:49.808 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-27T13:21:49.850 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T13:21:55.343 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-27T13:21:55.364 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T13:21:55.401 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:57.980 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T13:21:58.109 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T13:21:58.435 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T13:21:58.580 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:59.715 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:21:59.841 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-27T13:21:59.967 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:22:01.037 INFO:teuthology.orchestra.run.smithi099.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-27T13:22:01.037 INFO:teuthology.orchestra.run.smithi099.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-27T13:22:01.178 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:22:02.253 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-27T13:22:02.380 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-27T13:22:02.531 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T13:22:02.730 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-27T13:22:02.730 INFO:teuthology.orchestra.run.smithi099.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-27T13:22:24.546 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-27T13:22:24.547 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub' 2021-01-27T13:22:24.558 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T13:22:24.586 INFO:teuthology.orchestra.run.smithi099.stdout:Generating grub configuration file ... 2021-01-27T13:22:24.884 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T13:22:24.919 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T13:22:25.325 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T13:22:25.338 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T13:22:28.054 INFO:teuthology.orchestra.run.smithi099.stdout:done 2021-01-27T13:22:28.435 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2021-01-27T13:22:28.479 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2021-01-27T13:22:28.480 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2021-01-27T13:22:28.480 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2021-01-27T13:22:28.480 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2021-01-27T13:22:28.481 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 18 2021-01-27T13:22:28.481 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T13:22:28.481 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2021-01-27T13:22:28.482 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2021-01-27T13:22:28.482 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.4.0.65.68 2021-01-27T13:22:28.482 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T13:22:28.483 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T13:22:28.483 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2021-01-27T13:22:28.483 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2021-01-27T13:22:28.484 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2021-01-27T13:22:28.484 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2021-01-27T13:22:28.485 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-27T13:22:28.486 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-01-27T13:22:28.487 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-27T13:22:28.488 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-27T13:22:28.489 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-01-27T13:22:28.489 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2021-01-27T13:22:28.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get clean 2021-01-27T13:22:28.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2021-01-27T13:22:28.775 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T13:22:28.881 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T13:22:28.961 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T13:22:29.041 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T13:22:30.248 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2021-01-27T13:22:30.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T13:22:30.340 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2021-01-27T13:22:30.494 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2021-01-27T13:22:30.495 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2021-01-27T13:22:30.567 INFO:teuthology.orchestra.run.smithi037.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T13:22:30.569 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T13:22:30.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T13:22:30.638 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2021-01-27T13:22:30.778 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2021-01-27T13:22:30.778 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2021-01-27T13:22:30.926 INFO:teuthology.orchestra.run.smithi037.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-27T13:22:30.927 INFO:teuthology.orchestra.run.smithi037.stdout:0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T13:22:30.928 DEBUG:teuthology.orchestra.run.smithi037:> dpkg -s linux-image-generic 2021-01-27T13:22:30.945 INFO:teuthology.orchestra.run.smithi037.stdout:Package: linux-image-generic 2021-01-27T13:22:30.945 INFO:teuthology.orchestra.run.smithi037.stdout:Status: install ok installed 2021-01-27T13:22:30.945 INFO:teuthology.orchestra.run.smithi037.stdout:Priority: optional 2021-01-27T13:22:30.946 INFO:teuthology.orchestra.run.smithi037.stdout:Section: kernel 2021-01-27T13:22:30.946 INFO:teuthology.orchestra.run.smithi037.stdout:Installed-Size: 18 2021-01-27T13:22:30.946 INFO:teuthology.orchestra.run.smithi037.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T13:22:30.946 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: amd64 2021-01-27T13:22:30.947 INFO:teuthology.orchestra.run.smithi037.stdout:Source: linux-meta 2021-01-27T13:22:30.947 INFO:teuthology.orchestra.run.smithi037.stdout:Version: 5.4.0.65.68 2021-01-27T13:22:30.947 INFO:teuthology.orchestra.run.smithi037.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T13:22:30.947 INFO:teuthology.orchestra.run.smithi037.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T13:22:30.947 INFO:teuthology.orchestra.run.smithi037.stdout:Recommends: thermald 2021-01-27T13:22:30.948 INFO:teuthology.orchestra.run.smithi037.stdout:Description: Generic Linux kernel image 2021-01-27T13:22:30.948 INFO:teuthology.orchestra.run.smithi037.stdout: This package will always depend on the latest generic kernel image 2021-01-27T13:22:30.948 INFO:teuthology.orchestra.run.smithi037.stdout: available. 2021-01-27T13:22:30.949 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2021-01-27T13:22:30.954 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.EuRy9qkMkQ 2021-01-27T13:22:30.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub/grub.cfg /tmp/tmp.EuRy9qkMkQ 2021-01-27T13:22:30.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.EuRy9qkMkQ 2021-01-27T13:22:31.053 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.EuRy9qkMkQ is 8KB 2021-01-27T13:22:31.067 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.EuRy9qkMkQ 2021-01-27T13:22:31.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-27T13:22:31.084 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:22:31.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-27T13:22:31.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-27T13:22:31.131 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-27T13:22:31.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo update-grub 2021-01-27T13:22:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub' 2021-01-27T13:22:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T13:22:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2021-01-27T13:22:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T13:22:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T13:22:32.876 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T13:22:32.888 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T13:22:34.469 INFO:teuthology.orchestra.run.smithi037.stderr:done 2021-01-27T13:22:34.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2021-01-27T13:22:34.473 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-01-27T13:22:34.474 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2021-01-27T13:22:34.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2021-01-27T13:22:34.543 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2021-01-27T13:22:34.681 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T13:22:34.784 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T13:22:34.862 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T13:22:34.941 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T13:22:36.095 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-01-27T13:22:36.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T13:22:36.180 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-01-27T13:22:36.326 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-01-27T13:22:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-01-27T13:22:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T13:22:36.396 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T13:22:36.397 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T13:22:36.465 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-01-27T13:22:36.600 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-01-27T13:22:36.601 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-01-27T13:22:36.736 INFO:teuthology.orchestra.run.smithi099.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-27T13:22:36.736 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T13:22:36.738 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2021-01-27T13:22:36.755 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2021-01-27T13:22:36.756 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2021-01-27T13:22:36.756 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2021-01-27T13:22:36.756 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2021-01-27T13:22:36.756 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 18 2021-01-27T13:22:36.757 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T13:22:36.757 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2021-01-27T13:22:36.757 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2021-01-27T13:22:36.757 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.4.0.65.68 2021-01-27T13:22:36.757 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T13:22:36.758 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T13:22:36.758 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2021-01-27T13:22:36.758 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2021-01-27T13:22:36.759 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2021-01-27T13:22:36.759 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2021-01-27T13:22:36.759 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2021-01-27T13:22:36.764 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.h8uFWSmfho 2021-01-27T13:22:36.764 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub/grub.cfg /tmp/tmp.h8uFWSmfho 2021-01-27T13:22:36.820 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.h8uFWSmfho 2021-01-27T13:22:36.856 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.h8uFWSmfho is 8KB 2021-01-27T13:22:36.881 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.h8uFWSmfho 2021-01-27T13:22:36.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-27T13:22:36.943 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:22:36.944 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-27T13:22:36.944 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-27T13:22:36.978 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-27T13:22:36.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-grub 2021-01-27T13:22:38.311 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub' 2021-01-27T13:22:38.313 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T13:22:38.334 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2021-01-27T13:22:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T13:22:38.614 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T13:22:38.952 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T13:22:38.963 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T13:22:40.604 INFO:teuthology.orchestra.run.smithi099.stderr:done 2021-01-27T13:22:40.606 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2021-01-27T13:23:10.638 INFO:teuthology.misc:Re-opening connections... 2021-01-27T13:23:10.639 INFO:teuthology.misc:trying to connect to ubuntu@smithi037.front.sepia.ceph.com 2021-01-27T13:23:10.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:23:10.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:24:10.645 DEBUG:teuthology.orchestra.remote:timed out 2021-01-27T13:24:10.655 INFO:teuthology.misc:trying to connect to ubuntu@smithi099.front.sepia.ceph.com 2021-01-27T13:24:10.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:24:10.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:24:13.730 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2021-01-27T13:24:13.732 DEBUG:teuthology.misc:waited 63.092267990112305 2021-01-27T13:24:14.732 INFO:teuthology.misc:trying to connect to ubuntu@smithi037.front.sepia.ceph.com 2021-01-27T13:24:14.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:24:14.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:24:14.846 DEBUG:teuthology.orchestra.run.smithi037:> true 2021-01-27T13:24:15.359 DEBUG:teuthology.misc:waited 64.71937537193298 2021-01-27T13:24:16.360 INFO:teuthology.misc:trying to connect to ubuntu@smithi099.front.sepia.ceph.com 2021-01-27T13:24:16.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:24:16.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:24:16.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2021-01-27T13:24:16.804 DEBUG:teuthology.misc:waited 66.16491937637329 2021-01-27T13:24:17.805 INFO:teuthology.misc:trying to connect to ubuntu@smithi099.front.sepia.ceph.com 2021-01-27T13:24:17.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:24:17.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:24:20.359 DEBUG:teuthology.orchestra.remote:No existing session 2021-01-27T13:24:20.363 DEBUG:teuthology.misc:waited 69.72341775894165 2021-01-27T13:24:21.363 INFO:teuthology.misc:trying to connect to ubuntu@smithi099.front.sepia.ceph.com 2021-01-27T13:24:21.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:24:21.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:24:21.395 DEBUG:teuthology.orchestra.run.smithi099:> true 2021-01-27T13:24:22.257 DEBUG:teuthology.misc:waited 71.61792230606079 2021-01-27T13:24:23.258 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-01-27T13:24:23.258 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-65-generic"... 2021-01-27T13:24:23.259 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2021-01-27T13:24:23.267 INFO:teuthology.orchestra.run.smithi037.stdout:5.4.0-65-generic 2021-01-27T13:24:23.268 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-27T13:24:23.268 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-27T13:24:23.268 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-27T13:24:23.269 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-01-27T13:24:23.269 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-65-generic"... 2021-01-27T13:24:23.269 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2021-01-27T13:24:23.277 INFO:teuthology.orchestra.run.smithi099.stdout:5.4.0-65-generic 2021-01-27T13:24:23.278 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-27T13:24:23.278 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-27T13:24:23.278 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-27T13:24:24.279 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-01-27T13:24:24.280 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-27T13:24:24.372 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2021-01-27T13:24:24.397 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-01-27T13:24:24.397 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-27T13:24:24.546 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2021-01-27T13:24:24.570 INFO:teuthology.run_tasks:Running task internal.base... 2021-01-27T13:24:24.582 INFO:teuthology.task.internal:Creating test directory... 2021-01-27T13:24:24.584 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-27T13:24:24.587 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-27T13:24:24.595 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-01-27T13:24:24.673 INFO:teuthology.run_tasks:Running task internal.archive... 2021-01-27T13:24:24.708 INFO:teuthology.task.internal:Creating archive directory... 2021-01-27T13:24:24.709 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-27T13:24:24.712 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-27T13:24:24.737 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-01-27T13:24:24.748 INFO:teuthology.task.internal:Enabling coredump saving... 2021-01-27T13:24:24.749 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-27T13:24:24.752 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-27T13:24:24.774 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T13:24:24.780 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T13:24:24.784 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T13:24:24.790 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T13:24:24.793 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-01-27T13:24:24.806 INFO:teuthology.task.internal:Configuring sudo... 2021-01-27T13:24:24.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-27T13:24:24.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-27T13:24:24.852 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-01-27T13:24:24.869 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-01-27T13:24:24.869 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-27T13:24:24.872 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-27T13:24:24.904 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-27T13:24:24.926 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-27T13:24:24.934 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:24:24.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-27T13:24:24.957 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-27T13:24:24.966 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-27T13:24:25.017 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:24:25.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-27T13:24:25.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2021-01-27T13:24:25.060 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2021-01-27T13:24:25.150 INFO:teuthology.run_tasks:Running task internal.timer... 2021-01-27T13:24:25.166 INFO:teuthology.task.internal:Starting timer... 2021-01-27T13:24:25.167 INFO:teuthology.run_tasks:Running task pcp... 2021-01-27T13:24:25.226 INFO:teuthology.run_tasks:Running task selinux... 2021-01-27T13:24:25.281 DEBUG:teuthology.task.selinux:Excluding smithi037: OS 'ubuntu' does not support SELinux 2021-01-27T13:24:25.282 DEBUG:teuthology.task.selinux:Excluding smithi099: OS 'ubuntu' does not support SELinux 2021-01-27T13:24:25.283 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-01-27T13:24:25.284 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-01-27T13:24:25.284 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-01-27T13:24:25.285 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-01-27T13:24:25.308 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2021-01-27T13:24:25.310 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2021-01-27T13:24:25.531 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-01-27T13:24:25.537 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi099.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-01-27T13:24:26.427 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-01-27T13:24:28.664 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-01-27T13:24:31.935 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-01-27T13:24:31.979 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:31 +0000 (0:00:00.166) 0:00:00.166 ***** 2021-01-27T13:24:32.004 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:31 +0000 (0:00:00.024) 0:00:00.190 ***** 2021-01-27T13:24:34.230 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi037.front.sepia.ceph.com] 2021-01-27T13:24:34.286 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] 2021-01-27T13:24:34.329 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:34 +0000 (0:00:02.325) 0:00:02.516 ***** 2021-01-27T13:24:34.410 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:34 +0000 (0:00:00.080) 0:00:02.597 ***** 2021-01-27T13:24:34.610 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-01-27T13:24:34.611 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T13:24:34.650 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:34 +0000 (0:00:00.239) 0:00:02.837 ***** 2021-01-27T13:24:34.684 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:34 +0000 (0:00:00.034) 0:00:02.871 ***** 2021-01-27T13:24:35.186 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-01-27T13:24:35.188 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-27T13:24:35.190 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-27T13:24:35.245 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:35 +0000 (0:00:00.560) 0:00:03.432 ***** 2021-01-27T13:24:35.305 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:35 +0000 (0:00:00.059) 0:00:03.491 ***** 2021-01-27T13:24:35.581 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-01-27T13:24:35.583 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.066590", "end": "2021-01-27 13:24:35.266491", "rc": 0, "start": "2021-01-27 13:24:35.199901", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-27T13:24:35.631 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:35 +0000 (0:00:00.326) 0:00:03.818 ***** 2021-01-27T13:24:35.641 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.094675", "end": "2021-01-27 13:24:35.856065", "rc": 0, "start": "2021-01-27 13:24:35.761390", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-27T13:24:35.685 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:35 +0000 (0:00:00.054) 0:00:03.872 ***** 2021-01-27T13:24:36.004 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-01-27T13:24:36.007 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T13:24:36.048 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:36 +0000 (0:00:00.362) 0:00:04.235 ***** 2021-01-27T13:24:36.055 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T13:24:36.126 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:36 +0000 (0:00:00.077) 0:00:04.313 ***** 2021-01-27T13:24:36.885 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-01-27T13:24:36.887 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611753876.1517727-159050996595529/source", "state": "file", "uid": 0} 2021-01-27T13:24:36.925 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:36 +0000 (0:00:00.798) 0:00:05.112 ***** 2021-01-27T13:24:36.937 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611753876.0660744-57675196041261/source", "state": "file", "uid": 0} 2021-01-27T13:24:36.981 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:36 +0000 (0:00:00.055) 0:00:05.168 ***** 2021-01-27T13:24:37.283 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-01-27T13:24:37.285 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-27T13:24:37.287 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-27T13:24:37.359 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-27T13:24:37.361 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-27T13:24:37.453 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-01-27T13:24:37.462 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-01-27T13:24:37.619 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:37 +0000 (0:00:00.637) 0:00:05.805 ***** 2021-01-27T13:24:37.656 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:37 +0000 (0:00:00.037) 0:00:05.843 ***** 2021-01-27T13:24:38.507 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-01-27T13:24:38.509 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] 2021-01-27T13:24:38.562 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] 2021-01-27T13:24:38.615 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-01-27T13:24:38.617 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:38 +0000 (0:00:00.959) 0:00:06.802 ***** 2021-01-27T13:24:38.688 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:38 +0000 (0:00:00.072) 0:00:06.875 ***** 2021-01-27T13:24:39.368 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-01-27T13:24:39.370 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.433468", "end": "2021-01-27 13:24:39.337914", "rc": 0, "start": "2021-01-27 13:24:38.904446", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} changed: [smithi099.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.416776", "end": "2021-01-27 13:24:39.338053", "rc": 0, "start": "2021-01-27 13:24:38.921277", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T13:24:39.421 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.732) 0:00:07.608 ***** 2021-01-27T13:24:39.457 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.035) 0:00:07.644 ***** 2021-01-27T13:24:39.571 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-27T13:24:39.573 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014646", "end": "2021-01-27 13:24:39.259515", "failed_when_result": false, "rc": 0, "start": "2021-01-27 13:24:39.244869", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T13:24:39.611 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.153) 0:00:07.798 ***** 2021-01-27T13:24:39.639 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.035213", "end": "2021-01-27 13:24:39.884029", "failed_when_result": false, "rc": 0, "start": "2021-01-27 13:24:39.848816", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T13:24:39.641 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-27T13:24:39.675 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.064) 0:00:07.862 ***** 2021-01-27T13:24:39.710 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.035) 0:00:07.897 ***** 2021-01-27T13:24:39.717 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-27T13:24:39.718 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:39.754 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.043) 0:00:07.941 ***** 2021-01-27T13:24:39.764 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-27T13:24:39.766 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-27T13:24:39.801 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.046) 0:00:07.988 ***** 2021-01-27T13:24:39.809 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-27T13:24:39.811 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:39.860 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.058) 0:00:08.047 ***** 2021-01-27T13:24:39.867 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-27T13:24:39.870 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:39.906 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.045) 0:00:08.092 ***** 2021-01-27T13:24:39.914 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-27T13:24:39.916 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:39.967 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:39 +0000 (0:00:00.061) 0:00:08.154 ***** 2021-01-27T13:24:39.977 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-27T13:24:39.979 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.020 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:40 +0000 (0:00:00.053) 0:00:08.207 ***** 2021-01-27T13:24:40.027 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-27T13:24:40.029 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.066 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:40 +0000 (0:00:00.045) 0:00:08.253 ***** 2021-01-27T13:24:40.073 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-27T13:24:40.075 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.111 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:40 +0000 (0:00:00.044) 0:00:08.298 ***** 2021-01-27T13:24:40.117 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-01-27T13:24:40.119 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.155 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:40 +0000 (0:00:00.044) 0:00:08.342 ***** 2021-01-27T13:24:40.164 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-27T13:24:40.166 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.204 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:40 +0000 (0:00:00.048) 0:00:08.391 ***** 2021-01-27T13:24:40.211 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-27T13:24:40.213 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.223 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.225 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.263 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:40 +0000 (0:00:00.059) 0:00:08.450 ***** 2021-01-27T13:24:40.272 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-27T13:24:40.274 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-01-27T13:24:40.276 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_l 2021-01-27T13:24:40.277 INFO:teuthology.task.ansible.out:oop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.288 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.290 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.299 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.302 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.311 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.322 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.333 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.335 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.345 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.347 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.357 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.359 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.369 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.371 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.381 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.383 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e 2021-01-27T13:24:40.384 INFO:teuthology.task.ansible.out:453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.393 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.396 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": 2021-01-27T13:24:40.398 INFO:teuthology.task.ansible.out:"smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.406 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.408 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@elect 2021-01-27T13:24:40.410 INFO:teuthology.task.ansible.out:ric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.418 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.420 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4 2021-01-27T13:24:40.422 INFO:teuthology.task.ansible.out:M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.431 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.433 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94c 2021-01-27T13:24:40.436 INFO:teuthology.task.ansible.out:aa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.444 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.446 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.459 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.461 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.471 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.473 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.483 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.485 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.494 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.496 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a8 2021-01-27T13:24:40.498 INFO:teuthology.task.ansible.out:3ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.508 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.509 INFO:teuthology.task.ansible.out: 2021-01-27T13:24:40.511 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.512 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.514 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.525 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.527 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.538 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.541 INFO:teuthology.task.ansible.out: skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.542 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.552 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.554 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.555 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba659 2021-01-27T13:24:40.557 INFO:teuthology.task.ansible.out:4bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.567 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.570 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2021-01-27T13:24:40.572 INFO:teuthology.task.ansible.out:akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.580 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.583 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.593 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.595 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.605 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.607 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.617 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.619 INFO:teuthology.task.ansible.out: skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.629 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.632 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.643 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.645 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.655 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.657 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.668 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.670 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.680 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.681 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.682 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.682 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.684 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.694 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.695 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.706 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.708 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.719 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.721 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.722 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.734 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.736 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.747 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.748 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.759 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.761 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.772 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.773 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.785 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.787 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.787 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.788 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.789 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.789 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvb 2021-01-27T13:24:40.791 INFO:teuthology.task.ansible.out:JS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.801 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.803 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.803 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.816 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.818 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.818 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.820 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.831 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.833 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.844 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.844 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.846 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.847 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.862 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.866 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.888 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.890 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.891 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.902 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.905 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.906 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.907 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.918 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.921 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.931 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.933 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.944 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.945 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.958 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.960 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxu 2021-01-27T13:24:40.962 INFO:teuthology.task.ansible.out:ehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.972 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.973 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.974 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.975 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.976 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.978 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.988 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:40.989 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.000 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.003 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.003 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.015 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.017 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.018 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.018 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.029 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.031 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.041 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.043 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.044 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.044 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.055 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.058 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.058 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.092 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.093 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.094 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.095 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.096 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.153 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.889) 0:00:09.340 ***** 2021-01-27T13:24:41.164 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.165 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.167 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.167 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.168 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.168 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasa 2021-01-27T13:24:41.170 INFO:teuthology.task.ansible.out:d", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.182 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.184 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.230 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.076) 0:00:09.417 ***** 2021-01-27T13:24:41.237 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.239 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.240 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.242 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.242 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.244 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) 2021-01-27T13:24:41.246 INFO:teuthology.task.ansible.out:=> {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.256 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.259 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2021-01-27T13:24:41.259 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.310 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.080) 0:00:09.497 ***** 2021-01-27T13:24:41.317 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.318 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.319 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.374 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.063) 0:00:09.561 ***** 2021-01-27T13:24:41.383 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-27T13:24:41.384 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.420 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.046) 0:00:09.607 ***** 2021-01-27T13:24:41.426 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-27T13:24:41.465 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.044) 0:00:09.651 ***** 2021-01-27T13:24:41.471 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-27T13:24:41.473 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.509 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.044) 0:00:09.696 ***** 2021-01-27T13:24:41.519 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-27T13:24:41.521 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.562 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.052) 0:00:09.749 ***** 2021-01-27T13:24:41.568 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-27T13:24:41.570 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.605 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.043) 0:00:09.792 ***** 2021-01-27T13:24:41.612 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-27T13:24:41.614 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.653 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.048) 0:00:09.840 ***** 2021-01-27T13:24:41.659 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-01-27T13:24:41.660 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.699 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.046) 0:00:09.886 ***** 2021-01-27T13:24:41.705 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-27T13:24:41.707 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.750 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.051) 0:00:09.937 ***** 2021-01-27T13:24:41.757 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-27T13:24:41.759 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.760 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.771 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.773 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.783 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.784 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.795 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.797 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi037.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.846 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.095) 0:00:10.033 ***** 2021-01-27T13:24:41.854 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.855 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.856 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.857 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.858 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.859 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.881 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.882 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.919 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:41 +0000 (0:00:00.072) 0:00:10.105 ***** 2021-01-27T13:24:41.925 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-27T13:24:41.928 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.929 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.929 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.942 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.944 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.955 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.957 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.968 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.970 INFO:teuthology.task.ansible.out: skipping: [smithi099.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.972 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.973 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.975 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.985 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.987 INFO:teuthology.task.ansible.out: skipping: [smithi099.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.988 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:41.999 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.000 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.001 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.002 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.004 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.014 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.016 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.016 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.017 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.025 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.074 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:42 +0000 (0:00:00.154) 0:00:10.260 ***** 2021-01-27T13:24:42.082 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.083 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.083 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.085 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.085 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.088 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.089 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.089 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.100 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.102 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.113 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.114 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.124 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.126 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.136 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.137 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.147 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.149 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.158 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.160 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.170 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.171 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.181 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.183 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:42.222 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:42 +0000 (0:00:00.148) 0:00:10.409 ***** 2021-01-27T13:24:42.690 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-27T13:24:42.691 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-27T13:24:42.751 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:42 +0000 (0:00:00.529) 0:00:10.938 ***** 2021-01-27T13:24:42.786 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:42 +0000 (0:00:00.034) 0:00:10.973 ***** 2021-01-27T13:24:42.793 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-01-27T13:24:42.795 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => { "msg": "Host smithi037.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-27T13:24:42.840 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:42 +0000 (0:00:00.054) 0:00:11.027 ***** 2021-01-27T13:24:42.847 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => { "msg": "Host smithi099.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-27T13:24:42.886 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:42 +0000 (0:00:00.046) 0:00:11.073 ***** 2021-01-27T13:24:42.893 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-01-27T13:24:42.895 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-27T13:24:42.945 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:42 +0000 (0:00:00.058) 0:00:11.132 ***** 2021-01-27T13:24:42.955 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-27T13:24:43.003 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:42 +0000 (0:00:00.057) 0:00:11.190 ***** 2021-01-27T13:24:43.014 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-27T13:24:43.016 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.056 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.052) 0:00:11.242 ***** 2021-01-27T13:24:43.064 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.104 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.048) 0:00:11.290 ***** 2021-01-27T13:24:43.113 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-27T13:24:43.115 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.151 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.047) 0:00:11.338 ***** 2021-01-27T13:24:43.162 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.198 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.047) 0:00:11.385 ***** 2021-01-27T13:24:43.206 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-27T13:24:43.207 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.254 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.055) 0:00:11.441 ***** 2021-01-27T13:24:43.262 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.305 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.050) 0:00:11.491 ***** 2021-01-27T13:24:43.315 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.359 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.054) 0:00:11.546 ***** 2021-01-27T13:24:43.366 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.409 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.049) 0:00:11.596 ***** 2021-01-27T13:24:43.416 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-27T13:24:43.418 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.459 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.050) 0:00:11.646 ***** 2021-01-27T13:24:43.468 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.507 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.047) 0:00:11.694 ***** 2021-01-27T13:24:43.513 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-27T13:24:43.518 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.551 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.044) 0:00:11.738 ***** 2021-01-27T13:24:43.563 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.608 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.056) 0:00:11.795 ***** 2021-01-27T13:24:43.615 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-27T13:24:43.617 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.668 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.059) 0:00:11.855 ***** 2021-01-27T13:24:43.676 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.726 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.058) 0:00:11.913 ***** 2021-01-27T13:24:43.735 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-01-27T13:24:43.737 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.778 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.051) 0:00:11.964 ***** 2021-01-27T13:24:43.788 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:43.845 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.067) 0:00:12.032 ***** 2021-01-27T13:24:43.854 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-27T13:24:43.856 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:43.906 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.060) 0:00:12.092 ***** 2021-01-27T13:24:43.915 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:43.916 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:43.960 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:43 +0000 (0:00:00.054) 0:00:12.147 ***** 2021-01-27T13:24:43.969 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-27T13:24:43.970 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.015 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.054) 0:00:12.202 ***** 2021-01-27T13:24:44.024 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.065 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.050) 0:00:12.252 ***** 2021-01-27T13:24:44.073 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-27T13:24:44.075 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.109 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.043) 0:00:12.296 ***** 2021-01-27T13:24:44.116 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.154 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.044) 0:00:12.341 ***** 2021-01-27T13:24:44.160 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-01-27T13:24:44.162 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:44.203 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.049) 0:00:12.390 ***** 2021-01-27T13:24:44.213 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:44.270 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.067) 0:00:12.457 ***** 2021-01-27T13:24:44.277 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-27T13:24:44.279 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.317 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.046) 0:00:12.504 ***** 2021-01-27T13:24:44.324 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.367 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.050) 0:00:12.554 ***** 2021-01-27T13:24:44.374 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-01-27T13:24:44.376 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:44.410 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.042) 0:00:12.597 ***** 2021-01-27T13:24:44.418 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:44.464 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.053) 0:00:12.651 ***** 2021-01-27T13:24:44.472 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-27T13:24:44.474 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.525 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.060) 0:00:12.711 ***** 2021-01-27T13:24:44.534 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.574 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.049) 0:00:12.761 ***** 2021-01-27T13:24:44.580 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-27T13:24:44.582 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.618 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.043) 0:00:12.805 ***** 2021-01-27T13:24:44.626 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.663 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.045) 0:00:12.850 ***** 2021-01-27T13:24:44.669 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-27T13:24:44.671 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.707 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.044) 0:00:12.894 ***** 2021-01-27T13:24:44.717 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.760 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.052) 0:00:12.947 ***** 2021-01-27T13:24:44.769 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-01-27T13:24:44.771 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.813 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.053) 0:00:13.000 ***** 2021-01-27T13:24:44.822 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:44.873 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.059) 0:00:13.060 ***** 2021-01-27T13:24:44.880 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-27T13:24:44.882 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:44.927 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.054) 0:00:13.114 ***** 2021-01-27T13:24:44.936 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:44.984 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:44 +0000 (0:00:00.056) 0:00:13.170 ***** 2021-01-27T13:24:44.995 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T13:24:44.997 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.035 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.051) 0:00:13.222 ***** 2021-01-27T13:24:45.042 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.079 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.044) 0:00:13.266 ***** 2021-01-27T13:24:45.086 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-01-27T13:24:45.088 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.141 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.061) 0:00:13.328 ***** 2021-01-27T13:24:45.150 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.189 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.047) 0:00:13.376 ***** 2021-01-27T13:24:45.195 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-27T13:24:45.198 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.233 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.043) 0:00:13.420 ***** 2021-01-27T13:24:45.240 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.282 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.049) 0:00:13.469 ***** 2021-01-27T13:24:45.290 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-27T13:24:45.291 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.327 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.044) 0:00:13.514 ***** 2021-01-27T13:24:45.335 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.371 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.043) 0:00:13.558 ***** 2021-01-27T13:24:45.377 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-01-27T13:24:45.379 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.043) 0:00:13.601 ***** 2021-01-27T13:24:45.421 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.464 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.049) 0:00:13.651 ***** 2021-01-27T13:24:45.475 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-27T13:24:45.477 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.514 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.049) 0:00:13.700 ***** 2021-01-27T13:24:45.522 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.563 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.049) 0:00:13.750 ***** 2021-01-27T13:24:45.572 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-01-27T13:24:45.573 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:45.626 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.062) 0:00:13.813 ***** 2021-01-27T13:24:45.634 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:45.681 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.054) 0:00:13.867 ***** 2021-01-27T13:24:45.691 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.732 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.051) 0:00:13.918 ***** 2021-01-27T13:24:45.745 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.787 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.055) 0:00:13.974 ***** 2021-01-27T13:24:45.797 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-01-27T13:24:45.798 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.836 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.048) 0:00:14.023 ***** 2021-01-27T13:24:45.843 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.891 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.055) 0:00:14.078 ***** 2021-01-27T13:24:45.911 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:45.952 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.060) 0:00:14.139 ***** 2021-01-27T13:24:45.959 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.001 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:45 +0000 (0:00:00.048) 0:00:14.188 ***** 2021-01-27T13:24:46.007 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-27T13:24:46.009 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.048 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.046) 0:00:14.234 ***** 2021-01-27T13:24:46.054 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.055 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.094 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.045) 0:00:14.280 ***** 2021-01-27T13:24:46.100 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-01-27T13:24:46.102 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.138 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.044) 0:00:14.325 ***** 2021-01-27T13:24:46.145 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.147 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.182 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.043) 0:00:14.369 ***** 2021-01-27T13:24:46.188 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T13:24:46.189 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.226 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.043) 0:00:14.412 ***** 2021-01-27T13:24:46.232 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.269 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.044) 0:00:14.456 ***** 2021-01-27T13:24:46.382 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T13:24:46.384 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012185", "end": "2021-01-27 13:24:46.068971", "rc": 0, "start": "2021-01-27 13:24:46.056786", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-27T13:24:46.419 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.149) 0:00:14.606 ***** 2021-01-27T13:24:46.426 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012753", "end": "2021-01-27 13:24:46.668299", "rc": 0, "start": "2021-01-27 13:24:46.655546", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-27T13:24:46.464 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.045) 0:00:14.651 ***** 2021-01-27T13:24:46.470 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-27T13:24:46.472 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.513 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.047) 0:00:14.699 ***** 2021-01-27T13:24:46.519 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.558 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.046) 0:00:14.745 ***** 2021-01-27T13:24:46.564 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-01-27T13:24:46.566 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.628 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.069) 0:00:14.815 ***** 2021-01-27T13:24:46.636 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.676 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.048) 0:00:14.863 ***** 2021-01-27T13:24:46.683 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T13:24:46.685 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.736 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.060) 0:00:14.923 ***** 2021-01-27T13:24:46.744 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.783 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.046) 0:00:14.970 ***** 2021-01-27T13:24:46.791 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-01-27T13:24:46.793 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.829 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.045) 0:00:15.016 ***** 2021-01-27T13:24:46.836 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.873 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.044) 0:00:15.060 ***** 2021-01-27T13:24:46.880 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-27T13:24:46.882 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.917 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.043) 0:00:15.104 ***** 2021-01-27T13:24:46.928 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:46.972 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:46 +0000 (0:00:00.055) 0:00:15.159 ***** 2021-01-27T13:24:46.974 INFO:teuthology.task.ansible.out: 2021-01-27T13:24:46.981 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-27T13:24:46.982 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:47.018 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:47 +0000 (0:00:00.045) 0:00:15.205 ***** 2021-01-27T13:24:47.025 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:47.061 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:47 +0000 (0:00:00.042) 0:00:15.248 ***** 2021-01-27T13:24:47.067 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-01-27T13:24:47.069 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:47.104 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:47 +0000 (0:00:00.042) 0:00:15.291 ***** 2021-01-27T13:24:47.112 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:47.150 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:47 +0000 (0:00:00.045) 0:00:15.336 ***** 2021-01-27T13:24:47.808 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-27T13:24:47.810 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.575618", "end": "2021-01-27 13:24:47.500418", "rc": 0, "start": "2021-01-27 13:24:46.924800", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:24:47.849 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:47 +0000 (0:00:00.699) 0:00:16.036 ***** 2021-01-27T13:24:47.877 INFO:teuthology.task.ansible.out: 2021-01-27T13:24:47.878 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:47.921 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:47 +0000 (0:00:00.072) 0:00:16.108 ***** 2021-01-27T13:24:48.153 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-27T13:24:48.155 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.100793", "end": "2021-01-27 13:24:47.844542", "rc": 0, "start": "2021-01-27 13:24:47.743749", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:24:48.194 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:48 +0000 (0:00:00.273) 0:00:16.381 ***** 2021-01-27T13:24:48.256 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-27T13:24:48.258 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.972145", "end": "2021-01-27 13:24:48.500445", "rc": 0, "start": "2021-01-27 13:24:47.528300", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:24:48.296 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:48 +0000 (0:00:00.101) 0:00:16.483 ***** 2021-01-27T13:24:48.336 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:48.397 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:48 +0000 (0:00:00.100) 0:00:16.584 ***** 2021-01-27T13:24:48.613 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-27T13:24:48.614 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.073686", "end": "2021-01-27 13:24:48.860258", "rc": 0, "start": "2021-01-27 13:24:48.786572", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:24:48.650 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:48 +0000 (0:00:00.253) 0:00:16.837 ***** 2021-01-27T13:24:51.825 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-27T13:24:51.827 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611753690, "cache_updated": false, "changed": false} ok: [smithi037.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:24:51.865 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:51 +0000 (0:00:03.214) 0:00:20.052 ***** 2021-01-27T13:24:51.907 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:51 +0000 (0:00:00.041) 0:00:20.094 ***** 2021-01-27T13:24:52.555 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-27T13:24:52.557 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:24:52.595 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:52 +0000 (0:00:00.688) 0:00:20.782 ***** 2021-01-27T13:24:52.606 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:24:52.644 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:52 +0000 (0:00:00.049) 0:00:20.831 ***** 2021-01-27T13:24:52.650 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-27T13:24:52.653 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:52.691 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:52 +0000 (0:00:00.047) 0:00:20.878 ***** 2021-01-27T13:24:52.700 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:52.744 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:52 +0000 (0:00:00.052) 0:00:20.931 ***** 2021-01-27T13:24:53.028 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-27T13:24:53.030 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-27T13:24:53.068 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:53 +0000 (0:00:00.323) 0:00:21.255 ***** 2021-01-27T13:24:53.086 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-27T13:24:53.126 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:53 +0000 (0:00:00.058) 0:00:21.313 ***** 2021-01-27T13:24:53.727 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-01-27T13:24:53.728 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:24:53.781 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:53 +0000 (0:00:00.654) 0:00:21.968 ***** 2021-01-27T13:24:53.788 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:24:53.827 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:53 +0000 (0:00:00.046) 0:00:22.014 ***** 2021-01-27T13:24:54.150 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T13:24:54.152 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-27T13:24:54.172 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-27T13:24:54.466 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-27T13:24:54.468 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-27T13:24:54.760 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-27T13:24:54.765 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-27T13:24:54.807 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:54 +0000 (0:00:00.979) 0:00:22.994 ***** 2021-01-27T13:24:54.844 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:54 +0000 (0:00:00.036) 0:00:23.031 ***** 2021-01-27T13:24:54.938 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-27T13:24:54.940 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:24:54.981 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:54 +0000 (0:00:00.137) 0:00:23.168 ***** 2021-01-27T13:24:54.989 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:24:55.037 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:55 +0000 (0:00:00.055) 0:00:23.223 ***** 2021-01-27T13:24:55.311 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T13:24:55.445 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} ok: [smithi099.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-27T13:24:55.606 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-27T13:24:55.639 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-27T13:24:55.895 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-27T13:24:55.937 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:55 +0000 (0:00:00.900) 0:00:24.124 ***** 2021-01-27T13:24:55.945 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-27T13:24:55.995 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:55 +0000 (0:00:00.058) 0:00:24.182 ***** 2021-01-27T13:24:56.004 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-27T13:24:56.006 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-27T13:24:56.059 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.063) 0:00:24.246 ***** 2021-01-27T13:24:56.072 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-27T13:24:56.136 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.076) 0:00:24.322 ***** 2021-01-27T13:24:56.149 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-27T13:24:56.151 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.200 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.064) 0:00:24.387 ***** 2021-01-27T13:24:56.209 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.254 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.053) 0:00:24.441 ***** 2021-01-27T13:24:56.264 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:56.307 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.052) 0:00:24.494 ***** 2021-01-27T13:24:56.316 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:56.355 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.047) 0:00:24.541 ***** 2021-01-27T13:24:56.362 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-27T13:24:56.364 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.386 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.398 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.409 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.411 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.412 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.457 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.102) 0:00:24.644 ***** 2021-01-27T13:24:56.464 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.466 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.504 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.046) 0:00:24.691 ***** 2021-01-27T13:24:56.511 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-27T13:24:56.514 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.569 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.064) 0:00:24.756 ***** 2021-01-27T13:24:56.579 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:56.621 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:56 +0000 (0:00:00.052) 0:00:24.808 ***** 2021-01-27T13:24:57.272 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-27T13:24:57.274 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:24:57.328 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:57 +0000 (0:00:00.706) 0:00:25.515 ***** 2021-01-27T13:24:57.337 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:24:57.393 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:57 +0000 (0:00:00.064) 0:00:25.579 ***** 2021-01-27T13:24:57.716 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-27T13:24:57.718 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-27T13:24:57.767 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:57 +0000 (0:00:00.374) 0:00:25.954 ***** 2021-01-27T13:24:57.809 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-27T13:24:57.856 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:57 +0000 (0:00:00.088) 0:00:26.042 ***** 2021-01-27T13:24:58.114 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-27T13:24:58.116 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-27T13:24:58.171 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.315) 0:00:26.358 ***** 2021-01-27T13:24:58.202 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-27T13:24:58.254 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.082) 0:00:26.441 ***** 2021-01-27T13:24:58.334 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-27T13:24:58.336 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-27T13:24:58.399 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-27T13:24:58.443 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-27T13:24:58.483 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.228) 0:00:26.670 ***** 2021-01-27T13:24:58.510 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-27T13:24:58.512 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-27T13:24:58.514 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:58.551 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.068) 0:00:26.738 ***** 2021-01-27T13:24:58.587 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.036) 0:00:26.774 ***** 2021-01-27T13:24:58.593 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-27T13:24:58.595 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:58.635 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.048) 0:00:26.822 ***** 2021-01-27T13:24:58.642 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-27T13:24:58.644 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:58.680 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.044) 0:00:26.867 ***** 2021-01-27T13:24:58.685 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-27T13:24:58.687 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:58.722 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.042) 0:00:26.909 ***** 2021-01-27T13:24:58.729 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-27T13:24:58.731 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T13:24:58.766 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.043) 0:00:26.953 ***** 2021-01-27T13:24:58.800 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:58.840 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:58 +0000 (0:00:00.074) 0:00:27.027 ***** 2021-01-27T13:24:59.069 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-27T13:24:59.071 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-27T13:24:59.107 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:59 +0000 (0:00:00.266) 0:00:27.294 ***** 2021-01-27T13:24:59.167 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-27T13:24:59.208 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:59 +0000 (0:00:00.100) 0:00:27.394 ***** 2021-01-27T13:24:59.729 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-27T13:24:59.731 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 13:24:21 UTC", "ActiveEnterTimestampMonotonic": "16189424", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target nss-lookup.target network.target systemd-journald.socket basic.target system.slice var-run.mount sysinit.target systemd-tmpfiles-setup.service local-fs.target remote-fs.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 13:24:21 UTC", "AssertTimestampMonotonic": "16187792", "Before": "getty@tty1.service shutdown.target xdm.service multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 13:24:21 UTC", "Co 2021-01-27T13:24:59.733 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16187792", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "949", "ExecMainStartTimestamp": "Wed 2021-01-27 13:24:21 UTC", "ExecMainStartTimestampMonotonic": "16189271", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-01-27 13:24:21 UTC] ; stop_time=[n/a] ; pid=949 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-01-27 13:24:21 UTC] ; stop_time=[n/a] ; pid=949 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-01-27T13:24:59.735 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 13:24:21 UTC", "InactiveExitTimestampMonotonic": "16189424", "InvocationID": "cea45d7c66cc4cfd859fc97859fc58ec", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "949", "MemoryAccounting": "yes", "MemoryCurrent": "802816", "MemoryDe 2021-01-27T13:24:59.737 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 13:24:21 UTC", "StateChangeTimestampMonotonic": "16189424", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-01-27T13:24:59.738 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T13:24:59.739 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 13:24:01 UTC", "ActiveEnterTimestampMonotonic": "18274244", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service network.target sysinit.target local-fs.target time-sync.target systemd-journald.socket basic.target nss-lookup.target remote-fs.target system.slice var-run.mount -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 13:24:01 UTC", "AssertTimestampMonotonic": "18264247", "Before": "shutdown.target multi-user.target getty@tty1.service plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": " 2021-01-27T13:24:59.741 INFO:teuthology.task.ansible.out:yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 13:24:01 UTC", "ConditionTimestampMonotonic": "18264247", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "908", "ExecMainStartTimestamp": "Wed 2021-01-27 13:24:01 UTC", "ExecMainStartTimestampMonotonic": "18273954", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-01-27 13:24:01 UTC] ; stop_time=[n/a] 2021-01-27T13:24:59.742 INFO:teuthology.task.ansible.out:; pid=908 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-01-27 13:24:01 UTC] ; stop_time=[n/a] ; pid=908 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 13:24:01 UTC", "InactiveExitTimestampMonotonic": "18274244", "InvocationID": "f79334ee2b224b6cad619552d554b6a2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLO 2021-01-27T13:24:59.744 INFO:teuthology.task.ansible.out:CKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127805", "LimitNPROCSoft": "127805", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127805", "LimitSIGPENDINGSoft": "127805", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "908", "MemoryAccounting": "yes", "MemoryCurrent": "983040", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirector 2021-01-27T13:24:59.745 INFO:teuthology.task.ansible.out:yStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 13:24:01 UTC", "StateChangeTimestampMonotonic": "18274244", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38341", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T13:24:59.776 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:59 +0000 (0:00:00.568) 0:00:27.963 ***** 2021-01-27T13:24:59.810 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:59 +0000 (0:00:00.033) 0:00:27.997 ***** 2021-01-27T13:24:59.816 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-27T13:24:59.818 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:59.853 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:59 +0000 (0:00:00.042) 0:00:28.040 ***** 2021-01-27T13:24:59.861 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:59.896 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:59 +0000 (0:00:00.043) 0:00:28.083 ***** 2021-01-27T13:24:59.903 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-27T13:24:59.905 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:59.940 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:59 +0000 (0:00:00.043) 0:00:28.127 ***** 2021-01-27T13:24:59.947 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:24:59.984 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:24:59 +0000 (0:00:00.043) 0:00:28.171 ***** 2021-01-27T13:24:59.990 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-27T13:24:59.992 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.032 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.048) 0:00:28.219 ***** 2021-01-27T13:25:00.040 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.079 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.046) 0:00:28.266 ***** 2021-01-27T13:25:00.086 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.141 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.061) 0:00:28.328 ***** 2021-01-27T13:25:00.151 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.189 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.048) 0:00:28.376 ***** 2021-01-27T13:25:00.196 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-27T13:25:00.197 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.234 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.044) 0:00:28.421 ***** 2021-01-27T13:25:00.241 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.278 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.043) 0:00:28.465 ***** 2021-01-27T13:25:00.284 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-27T13:25:00.285 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.321 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.043) 0:00:28.508 ***** 2021-01-27T13:25:00.328 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.369 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.047) 0:00:28.555 ***** 2021-01-27T13:25:00.377 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-27T13:25:00.378 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.415 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.046) 0:00:28.601 ***** 2021-01-27T13:25:00.422 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.459 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.044) 0:00:28.646 ***** 2021-01-27T13:25:00.465 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-01-27T13:25:00.467 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.510 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.050) 0:00:28.696 ***** 2021-01-27T13:25:00.516 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.553 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.043) 0:00:28.740 ***** 2021-01-27T13:25:00.559 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-27T13:25:00.561 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.595 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.042) 0:00:28.782 ***** 2021-01-27T13:25:00.602 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.638 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.043) 0:00:28.825 ***** 2021-01-27T13:25:00.645 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.682 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.043) 0:00:28.869 ***** 2021-01-27T13:25:00.689 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:00.730 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.047) 0:00:28.917 ***** 2021-01-27T13:25:00.736 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-27T13:25:00.738 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-27T13:25:00.773 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.043) 0:00:28.960 ***** 2021-01-27T13:25:00.780 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-27T13:25:00.818 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.045) 0:00:29.005 ***** 2021-01-27T13:25:00.824 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-27T13:25:00.825 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-27T13:25:00.865 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.046) 0:00:29.052 ***** 2021-01-27T13:25:00.872 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-27T13:25:00.912 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.046) 0:00:29.098 ***** 2021-01-27T13:25:00.917 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-27T13:25:00.919 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-27T13:25:00.956 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.044) 0:00:29.143 ***** 2021-01-27T13:25:00.963 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-27T13:25:01.003 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:00 +0000 (0:00:00.046) 0:00:29.189 ***** 2021-01-27T13:25:01.011 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-27T13:25:01.012 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-27T13:25:01.050 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.047) 0:00:29.237 ***** 2021-01-27T13:25:01.057 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-27T13:25:01.097 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.047) 0:00:29.284 ***** 2021-01-27T13:25:01.177 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-27T13:25:01.179 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T13:25:01.218 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.120) 0:00:29.405 ***** 2021-01-27T13:25:01.236 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T13:25:01.273 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.054) 0:00:29.460 ***** 2021-01-27T13:25:01.353 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-27T13:25:01.355 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-27T13:25:01.391 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.117) 0:00:29.578 ***** 2021-01-27T13:25:01.411 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-27T13:25:01.412 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-27T13:25:01.412 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:01.452 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.061) 0:00:29.639 ***** 2021-01-27T13:25:01.487 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.034) 0:00:29.674 ***** 2021-01-27T13:25:01.613 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-27T13:25:01.615 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:01.648 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.161) 0:00:29.835 ***** 2021-01-27T13:25:01.655 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-27T13:25:01.657 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:01.692 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.044) 0:00:29.879 ***** 2021-01-27T13:25:01.720 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-27T13:25:01.722 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:01.755 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.062) 0:00:29.942 ***** 2021-01-27T13:25:01.803 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-27T13:25:01.805 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-27T13:25:01.841 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.085) 0:00:30.028 ***** 2021-01-27T13:25:01.902 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-27T13:25:01.940 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:01 +0000 (0:00:00.098) 0:00:30.127 ***** 2021-01-27T13:25:02.261 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-27T13:25:02.263 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-27T13:25:02.301 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:02 +0000 (0:00:00.361) 0:00:30.488 ***** 2021-01-27T13:25:02.329 INFO:teuthology.task.ansible.out: 2021-01-27T13:25:02.332 INFO:teuthology.task.ansible.out:TASK [testnode : Set hostname var] ********************************************* ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi037"}, "changed": false} 2021-01-27T13:25:02.369 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:02 +0000 (0:00:00.067) 0:00:30.555 ***** 2021-01-27T13:25:02.376 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-27T13:25:02.377 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-27T13:25:02.416 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:02 +0000 (0:00:00.047) 0:00:30.603 ***** 2021-01-27T13:25:02.465 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi099"}, "changed": false} 2021-01-27T13:25:02.502 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:02 +0000 (0:00:00.085) 0:00:30.689 ***** 2021-01-27T13:25:03.052 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-27T13:25:03.054 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi099.front.sepia.ceph.com", "ansible_hostname": "smithi099", "ansible_nodename": "smithi099"}, "changed": true, "name": "smithi099"} changed: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi037.front.sepia.ceph.com", "ansible_hostname": "smithi037", "ansible_nodename": "smithi037"}, "changed": true, "name": "smithi037"} 2021-01-27T13:25:03.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:03 +0000 (0:00:00.590) 0:00:31.279 ***** 2021-01-27T13:25:03.134 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:03 +0000 (0:00:00.041) 0:00:31.321 ***** 2021-01-27T13:25:03.414 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-27T13:25:03.416 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-27T13:25:03.456 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:03 +0000 (0:00:00.322) 0:00:31.643 ***** 2021-01-27T13:25:03.464 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-27T13:25:03.504 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:03 +0000 (0:00:00.047) 0:00:31.691 ***** 2021-01-27T13:25:03.773 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-27T13:25:03.775 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-27T13:25:03.812 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:03 +0000 (0:00:00.308) 0:00:31.999 ***** 2021-01-27T13:25:03.840 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-27T13:25:03.876 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:03 +0000 (0:00:00.064) 0:00:32.063 ***** 2021-01-27T13:25:04.434 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-01-27T13:25:04.436 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-27T13:25:04.470 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.593) 0:00:32.657 ***** 2021-01-27T13:25:04.477 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-27T13:25:04.513 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.043) 0:00:32.700 ***** 2021-01-27T13:25:04.519 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-27T13:25:04.521 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.556 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.042) 0:00:32.743 ***** 2021-01-27T13:25:04.563 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.601 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.044) 0:00:32.788 ***** 2021-01-27T13:25:04.607 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T13:25:04.609 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.644 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.042) 0:00:32.830 ***** 2021-01-27T13:25:04.651 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.687 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.043) 0:00:32.874 ***** 2021-01-27T13:25:04.694 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.731 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.043) 0:00:32.918 ***** 2021-01-27T13:25:04.737 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.777 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.046) 0:00:32.964 ***** 2021-01-27T13:25:04.784 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T13:25:04.785 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.826 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.048) 0:00:33.013 ***** 2021-01-27T13:25:04.836 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.877 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.050) 0:00:33.064 ***** 2021-01-27T13:25:04.884 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T13:25:04.885 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.922 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.045) 0:00:33.109 ***** 2021-01-27T13:25:04.930 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:04.970 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:04 +0000 (0:00:00.047) 0:00:33.157 ***** 2021-01-27T13:25:04.979 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T13:25:04.981 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.018 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.047) 0:00:33.205 ***** 2021-01-27T13:25:05.026 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.067 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.048) 0:00:33.253 ***** 2021-01-27T13:25:05.075 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T13:25:05.077 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.115 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.047) 0:00:33.301 ***** 2021-01-27T13:25:05.121 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.161 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.046) 0:00:33.348 ***** 2021-01-27T13:25:05.168 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-27T13:25:05.170 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.230 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.069) 0:00:33.417 ***** 2021-01-27T13:25:05.240 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.290 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.059) 0:00:33.477 ***** 2021-01-27T13:25:05.300 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-27T13:25:05.338 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.048) 0:00:33.525 ***** 2021-01-27T13:25:05.386 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.047) 0:00:33.573 ***** 2021-01-27T13:25:05.392 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-27T13:25:05.429 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.042) 0:00:33.616 ***** 2021-01-27T13:25:05.476 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.046) 0:00:33.662 ***** 2021-01-27T13:25:05.489 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-27T13:25:05.528 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.051) 0:00:33.714 ***** 2021-01-27T13:25:05.574 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.046) 0:00:33.761 ***** 2021-01-27T13:25:05.580 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-27T13:25:05.582 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.617 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.043) 0:00:33.804 ***** 2021-01-27T13:25:05.624 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.667 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.049) 0:00:33.853 ***** 2021-01-27T13:25:05.675 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-27T13:25:05.677 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.688 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.736 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.069) 0:00:33.923 ***** 2021-01-27T13:25:05.746 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.747 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.785 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.048) 0:00:33.972 ***** 2021-01-27T13:25:05.795 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.833 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.048) 0:00:34.020 ***** 2021-01-27T13:25:05.840 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.878 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.045) 0:00:34.065 ***** 2021-01-27T13:25:05.884 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:05.886 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.924 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.046) 0:00:34.111 ***** 2021-01-27T13:25:05.933 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:05.973 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:05 +0000 (0:00:00.048) 0:00:34.160 ***** 2021-01-27T13:25:05.980 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-27T13:25:05.982 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.017 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.044) 0:00:34.204 ***** 2021-01-27T13:25:06.025 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.073 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.055) 0:00:34.260 ***** 2021-01-27T13:25:06.083 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-27T13:25:06.084 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.124 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.050) 0:00:34.311 ***** 2021-01-27T13:25:06.132 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.176 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.051) 0:00:34.363 ***** 2021-01-27T13:25:06.184 INFO:teuthology.task.ansible.out: 2021-01-27T13:25:06.186 INFO:teuthology.task.ansible.out:TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.229 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.053) 0:00:34.416 ***** 2021-01-27T13:25:06.237 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.283 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.053) 0:00:34.470 ***** 2021-01-27T13:25:06.293 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-27T13:25:06.295 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.342 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.059) 0:00:34.529 ***** 2021-01-27T13:25:06.350 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.388 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.045) 0:00:34.575 ***** 2021-01-27T13:25:06.395 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T13:25:06.397 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.432 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.044) 0:00:34.619 ***** 2021-01-27T13:25:06.440 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.482 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.049) 0:00:34.668 ***** 2021-01-27T13:25:06.488 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T13:25:06.489 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.526 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.044) 0:00:34.713 ***** 2021-01-27T13:25:06.535 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.572 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.045) 0:00:34.758 ***** 2021-01-27T13:25:06.578 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T13:25:06.580 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.615 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.043) 0:00:34.802 ***** 2021-01-27T13:25:06.621 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.661 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.045) 0:00:34.847 ***** 2021-01-27T13:25:06.666 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-27T13:25:06.668 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.703 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.042) 0:00:34.890 ***** 2021-01-27T13:25:06.711 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.747 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.043) 0:00:34.934 ***** 2021-01-27T13:25:06.753 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T13:25:06.755 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.791 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.044) 0:00:34.978 ***** 2021-01-27T13:25:06.798 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.834 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.043) 0:00:35.021 ***** 2021-01-27T13:25:06.840 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T13:25:06.842 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.877 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.042) 0:00:35.064 ***** 2021-01-27T13:25:06.884 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.921 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.043) 0:00:35.107 ***** 2021-01-27T13:25:06.926 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-27T13:25:06.928 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:06.963 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.041) 0:00:35.149 ***** 2021-01-27T13:25:06.969 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.005 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:06 +0000 (0:00:00.042) 0:00:35.192 ***** 2021-01-27T13:25:07.012 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-27T13:25:07.014 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.048 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.042) 0:00:35.235 ***** 2021-01-27T13:25:07.056 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.043) 0:00:35.279 ***** 2021-01-27T13:25:07.094 INFO:teuthology.task.ansible.out: 2021-01-27T13:25:07.100 INFO:teuthology.task.ansible.out: 2021-01-27T13:25:07.102 INFO:teuthology.task.ansible.out:TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.139 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.047) 0:00:35.326 ***** 2021-01-27T13:25:07.146 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.185 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.045) 0:00:35.372 ***** 2021-01-27T13:25:07.192 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-27T13:25:07.194 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.229 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.044) 0:00:35.416 ***** 2021-01-27T13:25:07.236 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.277 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.046) 0:00:35.463 ***** 2021-01-27T13:25:07.284 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-27T13:25:07.286 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.322 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.045) 0:00:35.509 ***** 2021-01-27T13:25:07.331 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.366 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.043) 0:00:35.553 ***** 2021-01-27T13:25:07.373 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-27T13:25:07.375 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.048) 0:00:35.601 ***** 2021-01-27T13:25:07.423 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.460 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.045) 0:00:35.647 ***** 2021-01-27T13:25:07.467 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-27T13:25:07.469 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.505 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.044) 0:00:35.692 ***** 2021-01-27T13:25:07.513 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.550 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.044) 0:00:35.737 ***** 2021-01-27T13:25:07.556 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-27T13:25:07.557 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.592 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.042) 0:00:35.779 ***** 2021-01-27T13:25:07.599 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:07.636 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.043) 0:00:35.823 ***** 2021-01-27T13:25:07.725 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-27T13:25:07.727 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005474", "end": "2021-01-27 13:25:07.422609", "rc": 0, "start": "2021-01-27 13:25:07.417135", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:07.763 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.126) 0:00:35.950 ***** 2021-01-27T13:25:07.781 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005232", "end": "2021-01-27 13:25:08.024497", "rc": 0, "start": "2021-01-27 13:25:08.019265", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:07.816 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.053) 0:00:36.003 ***** 2021-01-27T13:25:07.823 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-27T13:25:07.859 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.042) 0:00:36.046 ***** 2021-01-27T13:25:07.903 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:07 +0000 (0:00:00.043) 0:00:36.090 ***** 2021-01-27T13:25:08.215 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-27T13:25:08.217 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-27T13:25:08.254 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:08 +0000 (0:00:00.351) 0:00:36.441 ***** 2021-01-27T13:25:08.262 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-27T13:25:08.301 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:08 +0000 (0:00:00.046) 0:00:36.488 ***** 2021-01-27T13:25:08.308 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-01-27T13:25:08.310 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:08.346 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:08 +0000 (0:00:00.045) 0:00:36.533 ***** 2021-01-27T13:25:08.354 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:08.393 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:08 +0000 (0:00:00.046) 0:00:36.580 ***** 2021-01-27T13:25:09.694 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-27T13:25:09.696 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-27T13:25:09.923 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-27T13:25:10.682 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-27T13:25:10.721 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:10 +0000 (0:00:02.327) 0:00:38.908 ***** 2021-01-27T13:25:10.884 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-27T13:25:10.922 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:10 +0000 (0:00:00.201) 0:00:39.109 ***** 2021-01-27T13:25:11.402 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-27T13:25:11.404 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:25:11.439 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:11 +0000 (0:00:00.516) 0:00:39.626 ***** 2021-01-27T13:25:11.468 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-27T13:25:11.507 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:11 +0000 (0:00:00.068) 0:00:39.694 ***** 2021-01-27T13:25:11.576 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-27T13:25:11.578 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:25:11.616 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:11 +0000 (0:00:00.108) 0:00:39.803 ***** 2021-01-27T13:25:11.643 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-27T13:25:11.680 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:11 +0000 (0:00:00.063) 0:00:39.867 ***** 2021-01-27T13:25:11.718 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-27T13:25:11.720 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034120", "end": "2021-01-27 13:25:11.409936", "rc": 0, "start": "2021-01-27 13:25:11.375816", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:11.756 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:11 +0000 (0:00:00.075) 0:00:39.943 ***** 2021-01-27T13:25:11.847 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034247", "end": "2021-01-27 13:25:12.096196", "rc": 0, "start": "2021-01-27 13:25:12.061949", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:11.885 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:11 +0000 (0:00:00.129) 0:00:40.072 ***** 2021-01-27T13:25:13.880 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-01-27T13:25:13.882 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:25:13.919 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:13 +0000 (0:00:02.033) 0:00:42.106 ***** 2021-01-27T13:25:14.010 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:25:14.048 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:14 +0000 (0:00:00.128) 0:00:42.234 ***** 2021-01-27T13:25:26.084 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-27T13:25:26.086 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-27T13:25:26.087 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T13:25:26.122 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:26 +0000 (0:00:12.073) 0:00:54.308 ***** 2021-01-27T13:25:26.563 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-27T13:25:26.564 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T13:25:26.610 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:26 +0000 (0:00:00.488) 0:00:54.797 ***** 2021-01-27T13:25:26.794 INFO:teuthology.task.ansible.out: 2021-01-27T13:25:26.796 INFO:teuthology.task.ansible.out:TASK [testnode : Upgrade packages] ********************************************* ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:25:26.838 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:26 +0000 (0:00:00.227) 0:00:55.025 ***** 2021-01-27T13:25:26.865 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:26.901 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:26 +0000 (0:00:00.063) 0:00:55.088 ***** 2021-01-27T13:25:27.254 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T13:25:27.256 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:25:27.293 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:27 +0000 (0:00:00.391) 0:00:55.480 ***** 2021-01-27T13:25:27.330 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-27T13:25:27.332 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:27.366 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:27 +0000 (0:00:00.072) 0:00:55.553 ***** 2021-01-27T13:25:36.331 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T13:25:36.333 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-27T13:25:36.335 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-27T13:25:36.337 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-27T13:25:36.338 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T13:25:36.369 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:36 +0000 (0:00:09.003) 0:01:04.556 ***** 2021-01-27T13:25:36.546 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (12.1 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-27T13:25:36.548 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-27T13:25:36.550 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (12.1 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-27T13:25:36.552 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T13:25:36.591 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:36 +0000 (0:00:00.221) 0:01:04.778 ***** 2021-01-27T13:25:37.030 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-27T13:25:37.032 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:25:37.069 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.477) 0:01:05.256 ***** 2021-01-27T13:25:37.211 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-27T13:25:37.213 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-27T13:25:37.250 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.181) 0:01:05.437 ***** 2021-01-27T13:25:37.258 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-27T13:25:37.260 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:25:37.315 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.065) 0:01:05.502 ***** 2021-01-27T13:25:37.324 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-27T13:25:37.326 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:37.375 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.060) 0:01:05.562 ***** 2021-01-27T13:25:37.444 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-27T13:25:37.446 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-27T13:25:37.485 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.109) 0:01:05.672 ***** 2021-01-27T13:25:37.511 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:37.513 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-27T13:25:37.548 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.063) 0:01:05.735 ***** 2021-01-27T13:25:37.582 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.033) 0:01:05.769 ***** 2021-01-27T13:25:37.716 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-27T13:25:37.753 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.170) 0:01:05.940 ***** 2021-01-27T13:25:37.897 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-27T13:25:37.899 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-27T13:25:37.939 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:37 +0000 (0:00:00.186) 0:01:06.126 ***** 2021-01-27T13:25:38.086 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-27T13:25:38.125 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.185) 0:01:06.312 ***** 2021-01-27T13:25:38.132 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-27T13:25:38.134 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-27T13:25:38.192 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.067) 0:01:06.379 ***** 2021-01-27T13:25:38.328 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-27T13:25:38.367 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.174) 0:01:06.554 ***** 2021-01-27T13:25:38.394 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-27T13:25:38.396 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T13:25:38.434 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.066) 0:01:06.621 ***** 2021-01-27T13:25:38.516 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T13:25:38.554 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.120) 0:01:06.741 ***** 2021-01-27T13:25:38.744 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-27T13:25:38.745 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 13:24:02 UTC", "ActiveEnterTimestampMonotonic": "18957197", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target nss-lookup.target remote-fs.target systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target -.mount system.slice basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 13:24:01 UTC", "AssertTimestampMonotonic": "18176213", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 13:24:01 UTC", "ConditionTimestampMonotonic": "18176213", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-27T13:25:38.747 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "948", "ExecMainStartTimestamp": "Wed 2021-01-27 13:24:02 UTC", "ExecMainStartTimestampMonotonic": "18957160", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-01-27T13:25:38.749 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 13:24:01 UTC", "InactiveExitTimestampMonotonic": "18178732", "InvocationID": "79993a209dd5473dbeb0d80b9232ec81", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127805", "LimitNPROCSoft": "127805", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127805", "LimitSIGPENDINGSoft": "127805", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "948", "MemoryAccounting": "yes", "MemoryCurrent": "9564160", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy 2021-01-27T13:25:38.751 INFO:teuthology.task.ansible.out:": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 13:24:02 UTC", "StateChangeTimestampMonotonic": "18957197", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38341", "TimeoutAbortUSec": " 2021-01-27T13:25:38.752 INFO:teuthology.task.ansible.out:1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T13:25:38.802 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.247) 0:01:06.988 ***** 2021-01-27T13:25:38.832 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 13:24:22 UTC", "ActiveEnterTimestampMonotonic": "16683207", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target remote-fs.target basic.target network.target systemd-journald.socket systemd-tmpfiles-setup.service system.slice -.mount nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 13:24:21 UTC", "AssertTimestampMonotonic": "16079684", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 13:24:21 UTC", "ConditionTimestampMonotonic": "16079684", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-27T13:25:38.834 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1094", "ExecMainStartTimestamp": "Wed 2021-01-27 13:24:22 UTC", "ExecMainStartTimestampMonotonic": "16683140", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-27T13:25:38.836 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 13:24:21 UTC", "InactiveExitTimestampMonotonic": "16080719", "InvocationID": "ce5a0bc588a04f9d83415667f92b3d0e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1094", "MemoryAccounting": "yes", "MemoryCurrent": "10219520", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2021-01-27T13:25:38.837 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 13:24:22 UTC", "StateChangeTimestampMonotonic": "16683207", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec" 2021-01-27T13:25:38.839 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:38.878 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.076) 0:01:07.065 ***** 2021-01-27T13:25:38.925 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.047) 0:01:07.112 ***** 2021-01-27T13:25:38.935 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T13:25:38.936 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.000 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:38 +0000 (0:00:00.074) 0:01:07.187 ***** 2021-01-27T13:25:39.017 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T13:25:39.019 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.070 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.069) 0:01:07.256 ***** 2021-01-27T13:25:39.076 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T13:25:39.078 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.139 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.069) 0:01:07.326 ***** 2021-01-27T13:25:39.149 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T13:25:39.150 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.196 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.056) 0:01:07.383 ***** 2021-01-27T13:25:39.204 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T13:25:39.206 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.244 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.047) 0:01:07.431 ***** 2021-01-27T13:25:39.251 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T13:25:39.253 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.300 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.056) 0:01:07.487 ***** 2021-01-27T13:25:39.310 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T13:25:39.312 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.355 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.055) 0:01:07.542 ***** 2021-01-27T13:25:39.367 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T13:25:39.369 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.419 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.063) 0:01:07.606 ***** 2021-01-27T13:25:39.430 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T13:25:39.431 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.476 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.057) 0:01:07.663 ***** 2021-01-27T13:25:39.484 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T13:25:39.486 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.536 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.059) 0:01:07.723 ***** 2021-01-27T13:25:39.543 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T13:25:39.545 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.588 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.051) 0:01:07.774 ***** 2021-01-27T13:25:39.595 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T13:25:39.596 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.649 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.061) 0:01:07.836 ***** 2021-01-27T13:25:39.658 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.704 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.055) 0:01:07.891 ***** 2021-01-27T13:25:39.713 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T13:25:39.715 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.755 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.050) 0:01:07.942 ***** 2021-01-27T13:25:39.763 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:39.765 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.803 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.048) 0:01:07.990 ***** 2021-01-27T13:25:39.812 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T13:25:39.814 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.852 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.048) 0:01:08.038 ***** 2021-01-27T13:25:39.859 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.900 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.048) 0:01:08.087 ***** 2021-01-27T13:25:39.907 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:39.909 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.944 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.043) 0:01:08.131 ***** 2021-01-27T13:25:39.950 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T13:25:39.952 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:39.998 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:39 +0000 (0:00:00.053) 0:01:08.184 ***** 2021-01-27T13:25:40.005 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T13:25:40.007 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.053 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.054) 0:01:08.239 ***** 2021-01-27T13:25:40.059 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T13:25:40.061 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.098 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.045) 0:01:08.285 ***** 2021-01-27T13:25:40.107 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T13:25:40.109 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.150 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.051) 0:01:08.337 ***** 2021-01-27T13:25:40.158 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T13:25:40.160 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.205 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.055) 0:01:08.392 ***** 2021-01-27T13:25:40.215 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T13:25:40.217 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.257 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.051) 0:01:08.444 ***** 2021-01-27T13:25:40.263 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T13:25:40.265 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.303 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.045) 0:01:08.490 ***** 2021-01-27T13:25:40.309 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T13:25:40.311 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.377 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.074) 0:01:08.564 ***** 2021-01-27T13:25:40.386 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T13:25:40.387 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.432 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.055) 0:01:08.619 ***** 2021-01-27T13:25:40.439 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T13:25:40.441 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.484 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.050) 0:01:08.670 ***** 2021-01-27T13:25:40.496 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T13:25:40.497 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.539 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.055) 0:01:08.726 ***** 2021-01-27T13:25:40.545 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T13:25:40.547 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.583 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.043) 0:01:08.770 ***** 2021-01-27T13:25:40.590 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T13:25:40.592 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.645 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.061) 0:01:08.832 ***** 2021-01-27T13:25:40.654 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T13:25:40.655 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.699 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.054) 0:01:08.886 ***** 2021-01-27T13:25:40.707 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T13:25:40.708 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.752 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.052) 0:01:08.939 ***** 2021-01-27T13:25:40.758 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T13:25:40.760 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.802 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.049) 0:01:08.988 ***** 2021-01-27T13:25:40.808 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T13:25:40.811 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.846 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.044) 0:01:09.033 ***** 2021-01-27T13:25:40.854 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T13:25:40.855 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.890 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.044) 0:01:09.077 ***** 2021-01-27T13:25:40.896 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T13:25:40.898 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.934 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.044) 0:01:09.121 ***** 2021-01-27T13:25:40.941 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T13:25:40.943 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:40.989 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:40 +0000 (0:00:00.054) 0:01:09.176 ***** 2021-01-27T13:25:40.995 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T13:25:40.997 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.033 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.044) 0:01:09.220 ***** 2021-01-27T13:25:41.040 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T13:25:41.042 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.059) 0:01:09.279 ***** 2021-01-27T13:25:41.102 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T13:25:41.104 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.139 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.046) 0:01:09.326 ***** 2021-01-27T13:25:41.146 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T13:25:41.148 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.183 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.043) 0:01:09.370 ***** 2021-01-27T13:25:41.190 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T13:25:41.192 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.227 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.044) 0:01:09.414 ***** 2021-01-27T13:25:41.234 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T13:25:41.235 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.271 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.044) 0:01:09.458 ***** 2021-01-27T13:25:41.278 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T13:25:41.279 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.315 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.044) 0:01:09.502 ***** 2021-01-27T13:25:41.322 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T13:25:41.324 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.361 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.045) 0:01:09.547 ***** 2021-01-27T13:25:41.367 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T13:25:41.369 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.405 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.044) 0:01:09.592 ***** 2021-01-27T13:25:41.412 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T13:25:41.414 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.462 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.057) 0:01:09.649 ***** 2021-01-27T13:25:41.469 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-27T13:25:41.471 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.520 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.057) 0:01:09.707 ***** 2021-01-27T13:25:41.533 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T13:25:41.535 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.572 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.051) 0:01:09.758 ***** 2021-01-27T13:25:41.598 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-27T13:25:41.601 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:41.635 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.063) 0:01:09.822 ***** 2021-01-27T13:25:41.673 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-27T13:25:41.675 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-27T13:25:41.726 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.090) 0:01:09.912 ***** 2021-01-27T13:25:41.775 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-27T13:25:41.813 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:41 +0000 (0:00:00.086) 0:01:09.999 ***** 2021-01-27T13:25:42.062 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T13:25:42.064 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-27T13:25:42.107 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:42 +0000 (0:00:00.294) 0:01:10.294 ***** 2021-01-27T13:25:42.137 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-27T13:25:42.181 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:42 +0000 (0:00:00.074) 0:01:10.368 ***** 2021-01-27T13:25:42.188 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T13:25:42.190 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:42.230 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:42 +0000 (0:00:00.048) 0:01:10.417 ***** 2021-01-27T13:25:42.238 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:42.290 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:42 +0000 (0:00:00.060) 0:01:10.477 ***** 2021-01-27T13:25:42.555 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-27T13:25:42.557 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-27T13:25:42.608 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:42 +0000 (0:00:00.317) 0:01:10.795 ***** 2021-01-27T13:25:42.638 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-27T13:25:42.682 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:42 +0000 (0:00:00.071) 0:01:10.866 ***** 2021-01-27T13:25:42.944 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-27T13:25:42.945 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-27T13:25:42.985 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:42 +0000 (0:00:00.305) 0:01:11.172 ***** 2021-01-27T13:25:43.013 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-27T13:25:43.053 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.068) 0:01:11.240 ***** 2021-01-27T13:25:43.304 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-27T13:25:43.306 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-27T13:25:43.342 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.288) 0:01:11.529 ***** 2021-01-27T13:25:43.369 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-27T13:25:43.406 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.063) 0:01:11.593 ***** 2021-01-27T13:25:43.476 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T13:25:43.514 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.107) 0:01:11.700 ***** 2021-01-27T13:25:43.542 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T13:25:43.544 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.580 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.066) 0:01:11.767 ***** 2021-01-27T13:25:43.616 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.035) 0:01:11.803 ***** 2021-01-27T13:25:43.623 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-27T13:25:43.625 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.659 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.042) 0:01:11.846 ***** 2021-01-27T13:25:43.665 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-27T13:25:43.667 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.702 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.043) 0:01:11.889 ***** 2021-01-27T13:25:43.708 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-27T13:25:43.709 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.745 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.042) 0:01:11.932 ***** 2021-01-27T13:25:43.751 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-27T13:25:43.753 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.788 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.042) 0:01:11.975 ***** 2021-01-27T13:25:43.794 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-27T13:25:43.796 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.831 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.042) 0:01:12.018 ***** 2021-01-27T13:25:43.837 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-27T13:25:43.839 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.877 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.046) 0:01:12.064 ***** 2021-01-27T13:25:43.883 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-27T13:25:43.885 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.920 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.042) 0:01:12.107 ***** 2021-01-27T13:25:43.926 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-27T13:25:43.928 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:43.964 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:43 +0000 (0:00:00.044) 0:01:12.151 ***** 2021-01-27T13:25:43.970 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:43.972 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-27T13:25:44.007 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.043) 0:01:12.194 ***** 2021-01-27T13:25:44.014 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-27T13:25:44.015 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.053 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.045) 0:01:12.240 ***** 2021-01-27T13:25:44.062 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-27T13:25:44.063 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.075 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.077 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.087 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:44.088 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi037.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.131 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.078) 0:01:12.318 ***** 2021-01-27T13:25:44.141 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-27T13:25:44.142 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.143 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.145 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.157 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.159 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.211 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.080) 0:01:12.398 ***** 2021-01-27T13:25:44.219 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.221 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.232 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.234 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.244 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-27T13:25:44.255 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.256 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.266 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.277 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.279 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.288 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.300 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.302 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.351 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.139) 0:01:12.538 ***** 2021-01-27T13:25:44.424 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-27T13:25:44.426 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004980", "end": "2021-01-27 13:25:44.402146", "rc": 0, "start": "2021-01-27 13:25:44.397166", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-27T13:25:44.467 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.115) 0:01:12.653 ***** 2021-01-27T13:25:44.505 INFO:teuthology.task.ansible.out: 2021-01-27T13:25:44.506 INFO:teuthology.task.ansible.out:TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-27T13:25:44.506 INFO:teuthology.task.ansible.out: 2021-01-27T13:25:44.507 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.563 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.095) 0:01:12.749 ***** 2021-01-27T13:25:44.581 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-27T13:25:44.582 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003587", "end": "2021-01-27 13:25:44.558487", "rc": 0, "start": "2021-01-27 13:25:44.554900", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-27T13:25:44.621 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.058) 0:01:12.808 ***** 2021-01-27T13:25:44.627 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-01-27T13:25:44.628 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.670 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.048) 0:01:12.857 ***** 2021-01-27T13:25:44.676 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-27T13:25:44.678 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.718 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.048) 0:01:12.905 ***** 2021-01-27T13:25:44.724 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-27T13:25:44.726 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.763 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.044) 0:01:12.950 ***** 2021-01-27T13:25:44.770 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-01-27T13:25:44.772 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.809 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.045) 0:01:12.996 ***** 2021-01-27T13:25:44.836 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-27T13:25:44.838 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:44.875 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:44 +0000 (0:00:00.066) 0:01:13.062 ***** 2021-01-27T13:25:45.421 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-27T13:25:45.423 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:25:45.459 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.584) 0:01:13.646 ***** 2021-01-27T13:25:45.486 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-27T13:25:45.488 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:45.523 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.063) 0:01:13.710 ***** 2021-01-27T13:25:45.529 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-27T13:25:45.531 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:25:45.568 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.044) 0:01:13.754 ***** 2021-01-27T13:25:45.573 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T13:25:45.574 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item={'block_used': 13965194, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129914, 'size_available': 926228127744, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165092, 'block_size': 4096, 'inode_available': 60889884}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129914, "block_size": 4096, "block_total": 240095108, "block_used": 13965194, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889884, "inode_total": 61054976, "inode_used": 165092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228127744, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-27T13:25:45.611 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.043) 0:01:13.798 ***** 2021-01-27T13:25:45.617 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-27T13:25:45.619 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:45.655 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.043) 0:01:13.842 ***** 2021-01-27T13:25:45.706 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T13:25:45.707 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item={'block_used': 13965190, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129918, 'size_available': 926228144128, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129918, "block_size": 4096, "block_total": 240095108, "block_used": 13965190, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228144128, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-27T13:25:45.743 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.088) 0:01:13.930 ***** 2021-01-27T13:25:45.760 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-27T13:25:45.761 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009466", "end": "2021-01-27 13:25:45.448751", "rc": 0, "start": "2021-01-27 13:25:45.439285", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:45.796 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.052) 0:01:13.983 ***** 2021-01-27T13:25:45.834 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-27T13:25:45.835 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'block_used': 13965194, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129914, 'size_available': 926228127744, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165092, 'block_size': 4096, 'inode_available': 60889884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129914, "block_size": 4096, "block_total": 240095108, "block_used": 13965194, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889884, "inode_total": 61054976, "inode_used": 165092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228127744, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:45.875 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.078) 0:01:14.062 ***** 2021-01-27T13:25:45.895 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-27T13:25:45.897 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009412", "end": "2021-01-27 13:25:46.139523", "rc": 0, "start": "2021-01-27 13:25:46.130111", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:45.938 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.062) 0:01:14.124 ***** 2021-01-27T13:25:45.948 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-27T13:25:46.000 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:45 +0000 (0:00:00.062) 0:01:14.187 ***** 2021-01-27T13:25:46.007 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-27T13:25:46.009 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'block_used': 13965190, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129918, 'size_available': 926228144128, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129918, "block_size": 4096, "block_total": 240095108, "block_used": 13965190, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228144128, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:46.053 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:46 +0000 (0:00:00.052) 0:01:14.240 ***** 2021-01-27T13:25:46.060 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T13:25:46.061 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:46.072 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-27T13:25:46.109 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:46 +0000 (0:00:00.055) 0:01:14.296 ***** 2021-01-27T13:25:46.158 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T13:25:46.160 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:47.707 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77Po7ILV2QkAiH1q18RSwYe3OeDzMZLPi7x'], 'uuids': ['ac2ab099-6556-4ef2-a80d-bf7d254d0ff2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.534957", "end": "2021-01-27 13:25:47.394142", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77Po7ILV2QkAiH1q18RSwYe3OeDzMZLPi7x"], "labels": [], "masters": [], "uuids": ["ac2ab099-6556-4ef2-a80d-bf7d254d0ff2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:45.859185", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:47.718 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:47.730 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:47.948 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00UKyeyA04umEtD6Zd25mlpUXx48t0sKDw'], 'uuids': ['3831be1b-b698-4ceb-a960-d8f758edc178']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.656135", "end": "2021-01-27 13:25:48.190596", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00UKyeyA04umEtD6Zd25mlpUXx48t0sKDw"], "labels": [], "masters": [], "uuids": ["3831be1b-b698-4ceb-a960-d8f758edc178"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:46.534461", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:47.950 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:47.961 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:49.023 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PxHIoroov5t9QWYBMc1PlbOQalcRN03ZP'], 'uuids': ['a737f8bc-4721-40aa-b7fd-fb505175fa4b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.160018", "end": "2021-01-27 13:25:48.704109", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PxHIoroov5t9QWYBMc1PlbOQalcRN03ZP"], "labels": [], "masters": [], "uuids": ["a737f8bc-4721-40aa-b7fd-fb505175fa4b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:47.544091", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:49.024 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRZS', 'wwn-0x5000c500871a25c9'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRZS-part1', 'wwn-0x5000c500871a25c9-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a25c9', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HRZS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRZS", "wwn-0x5000c500871a25c9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRZS-part1", "wwn-0x5000c500871a25c9-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRZS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a25c9"}}, 2021-01-27T13:25:49.026 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T13:25:49.214 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr003cvVMDUO2axtSQei1wwQ7ichn2vhW2rB'], 'uuids': ['194dfe34-057b-49eb-802d-486c7493b903']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.124637", "end": "2021-01-27 13:25:49.454610", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr003cvVMDUO2axtSQei1wwQ7ichn2vhW2rB"], "labels": [], "masters": [], "uuids": ["194dfe34-057b-49eb-802d-486c7493b903"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:48.329973", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:49.225 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHPN', 'wwn-0x5000c500918da8bc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHPN-part1', 'wwn-0x5000c500918da8bc-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918da8bc', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LHPN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHPN", "wwn-0x5000c500918da8bc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHPN-part1", "wwn-0x5000c500918da8bc-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LHPN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918da8bc"}}, 2021-01-27T13:25:49.227 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T13:25:50.400 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-TQdWUs-cPSq-51I2-cFs2-tOzc-D3oC-QSgVfB', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331005T400BGN', 'nvme-nvme.8086-43564654353333313030355434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.249972", "end": "2021-01-27 13:25:50.084664", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-TQdWUs-cPSq-51I2-cFs2-tOzc-D3oC-QSgVfB", "nvme-INTEL_SSDPEDMD400G4_CVFT5331005T400BGN", "nvme-nvme.8086-43564654353333313030355434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:48.834692", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-27T13:25:50.402 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:50.411 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:50.423 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:50.550 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-7eFdu9-ifmN-DcQG-Ynvs-GwNk-cXQy-g6V8Hq', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040101400BGN', 'nvme-nvme.8086-50484654363230343031303134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.203569", "end": "2021-01-27 13:25:50.798040", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-7eFdu9-ifmN-DcQG-Ynvs-GwNk-cXQy-g6V8Hq", "nvme-INTEL_SSDPEDMD400G4_PHFT62040101400BGN", "nvme-nvme.8086-50484654363230343031303134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:49.594471", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-27T13:25:50.552 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:50.563 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:50.574 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:51.688 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PuG7wMfZ6XT3QO84nUZlnmRdnHyr2DXxZ'], 'uuids': ['a361ba66-a8c7-42c9-bf01-6949c156e1ca']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.136640", "end": "2021-01-27 13:25:51.370291", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PuG7wMfZ6XT3QO84nUZlnmRdnHyr2DXxZ"], "labels": [], "masters": [], "uuids": ["a361ba66-a8c7-42c9-bf01-6949c156e1ca"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:50.233651", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:51.699 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:51.700 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:51.867 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00KOqxuPqDHzNlYlqsO3hDNt00Rcykcsyq'], 'uuids': ['0230f15e-81ce-4a98-8e1a-4cb8902b93d8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.176088", "end": "2021-01-27 13:25:52.112812", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00KOqxuPqDHzNlYlqsO3hDNt00Rcykcsyq"], "labels": [], "masters": [], "uuids": ["0230f15e-81ce-4a98-8e1a-4cb8902b93d8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:50.936724", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:51.878 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:51.890 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:52.988 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PH77JjeCgi6Iq0tkKXaP6UBHizOsfLO7v'], 'uuids': ['fe6f968e-325f-480c-b794-d5ad45164a4a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.157815", "end": "2021-01-27 13:25:52.670593", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PH77JjeCgi6Iq0tkKXaP6UBHizOsfLO7v"], "labels": [], "masters": [], "uuids": ["fe6f968e-325f-480c-b794-d5ad45164a4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:51.512778", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:52.990 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:53.146 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr002AYIApWeYkZRQV9wDAwc1mkDuT33Iyyd'], 'uuids': ['8929c498-72c5-431c-b41f-6272498e06cf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.130120", "end": "2021-01-27 13:25:53.389294", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr002AYIApWeYkZRQV9wDAwc1mkDuT33Iyyd"], "labels": [], "masters": [], "uuids": ["8929c498-72c5-431c-b41f-6272498e06cf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:52.259174", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:53.158 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:54.265 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PNCyFZdcXMKvLCpearG4taJsO1rE5yUS3'], 'uuids': ['21346ad4-9ef8-4bb5-a5ba-e1cd501b26e8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.145555", "end": "2021-01-27 13:25:53.949667", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PNCyFZdcXMKvLCpearG4taJsO1rE5yUS3"], "labels": [], "masters": [], "uuids": ["21346ad4-9ef8-4bb5-a5ba-e1cd501b26e8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:52.804112", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:54.340 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:54 +0000 (0:00:08.231) 0:01:22.527 ***** 2021-01-27T13:25:54.388 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T13:25:54.390 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:54.432 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T13:25:54.433 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00wQdWbdPFlYcLWBAYhZKF4Qfk2JCQjyLI'], 'uuids': ['afb746b6-8294-4102-b83e-3f4a00c62efe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.146879", "end": "2021-01-27 13:25:54.672225", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00wQdWbdPFlYcLWBAYhZKF4Qfk2JCQjyLI"], "labels": [], "masters": [], "uuids": ["afb746b6-8294-4102-b83e-3f4a00c62efe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:53.525346", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T13:25:54.480 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:54 +0000 (0:00:00.139) 0:01:22.666 ***** 2021-01-27T13:25:54.528 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T13:25:54.530 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:54.677 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77Po7ILV2QkAiH1q18RSwYe3OeDzMZLPi7x'], 'uuids': ['ac2ab099-6556-4ef2-a80d-bf7d254d0ff2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.163135", "end": "2021-01-27 13:25:54.364606", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77Po7ILV2QkAiH1q18RSwYe3OeDzMZLPi7x"], "labels": [], "masters": [], "uuids": ["ac2ab099-6556-4ef2-a80d-bf7d254d0ff2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:54.201471", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158252 s, 729 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158252 s, 729 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:54.690 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:54.702 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:54.819 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00UKyeyA04umEtD6Zd25mlpUXx48t0sKDw'], 'uuids': ['3831be1b-b698-4ceb-a960-d8f758edc178']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.167937", "end": "2021-01-27 13:25:55.068236", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00UKyeyA04umEtD6Zd25mlpUXx48t0sKDw"], "labels": [], "masters": [], "uuids": ["3831be1b-b698-4ceb-a960-d8f758edc178"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:54.900299", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16295 s, 708 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16295 s, 708 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:54.831 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:54.844 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:54.993 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PxHIoroov5t9QWYBMc1PlbOQalcRN03ZP'], 'uuids': ['a737f8bc-4721-40aa-b7fd-fb505175fa4b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.161890", "end": "2021-01-27 13:25:54.674446", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PxHIoroov5t9QWYBMc1PlbOQalcRN03ZP"], "labels": [], "masters": [], "uuids": ["a737f8bc-4721-40aa-b7fd-fb505175fa4b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:54.512556", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156797 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156797 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:54.994 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRZS', 'wwn-0x5000c500871a25c9'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HRZS-part1', 'wwn-0x5000c500871a25c9-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a25c9', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HRZS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRZS", "wwn-0x5000c500871a25c9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HRZS-part1", "wwn-0x5000c500871a25c9-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HRZS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a25c9"}}, 2021-01-27T13:25:54.996 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.131 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr003cvVMDUO2axtSQei1wwQ7ichn2vhW2rB'], 'uuids': ['194dfe34-057b-49eb-802d-486c7493b903']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.167386", "end": "2021-01-27 13:25:55.380241", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr003cvVMDUO2axtSQei1wwQ7ichn2vhW2rB"], "labels": [], "masters": [], "uuids": ["194dfe34-057b-49eb-802d-486c7493b903"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:55.212855", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162654 s, 709 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162654 s, 709 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:55.143 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHPN', 'wwn-0x5000c500918da8bc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LHPN-part1', 'wwn-0x5000c500918da8bc-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918da8bc', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LHPN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHPN", "wwn-0x5000c500918da8bc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LHPN-part1", "wwn-0x5000c500918da8bc-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LHPN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918da8bc"}}, 2021-01-27T13:25:55.145 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.175 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-TQdWUs-cPSq-51I2-cFs2-tOzc-D3oC-QSgVfB', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331005T400BGN', 'nvme-nvme.8086-43564654353333313030355434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059091", "end": "2021-01-27 13:25:54.865143", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-TQdWUs-cPSq-51I2-cFs2-tOzc-D3oC-QSgVfB", "nvme-INTEL_SSDPEDMD400G4_CVFT5331005T400BGN", "nvme-nvme.8086-43564654353333313030355434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:54.806052", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0541237 s, 2.1 GB/s", "std 2021-01-27T13:25:55.177 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0541237 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:55.187 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.200 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.348 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-7eFdu9-ifmN-DcQG-Ynvs-GwNk-cXQy-g6V8Hq', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040101400BGN', 'nvme-nvme.8086-50484654363230343031303134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059428", "end": "2021-01-27 13:25:55.595351", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-7eFdu9-ifmN-DcQG-Ynvs-GwNk-cXQy-g6V8Hq", "nvme-INTEL_SSDPEDMD400G4_PHFT62040101400BGN", "nvme-nvme.8086-50484654363230343031303134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:55.535923", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0557836 s, 2.1 GB/s", "std 2021-01-27T13:25:55.350 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0557836 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:55.361 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.363 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.470 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PuG7wMfZ6XT3QO84nUZlnmRdnHyr2DXxZ'], 'uuids': ['a361ba66-a8c7-42c9-bf01-6949c156e1ca']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.152852", "end": "2021-01-27 13:25:55.156457", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PuG7wMfZ6XT3QO84nUZlnmRdnHyr2DXxZ"], "labels": [], "masters": [], "uuids": ["a361ba66-a8c7-42c9-bf01-6949c156e1ca"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:55.003605", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148478 s, 777 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148478 s, 777 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:55.483 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.485 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.665 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00KOqxuPqDHzNlYlqsO3hDNt00Rcykcsyq'], 'uuids': ['0230f15e-81ce-4a98-8e1a-4cb8902b93d8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.171559", "end": "2021-01-27 13:25:55.905333", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00KOqxuPqDHzNlYlqsO3hDNt00Rcykcsyq"], "labels": [], "masters": [], "uuids": ["0230f15e-81ce-4a98-8e1a-4cb8902b93d8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:55.733774", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.166793 s, 692 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.166793 s, 692 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:55.677 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.688 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.795 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PH77JjeCgi6Iq0tkKXaP6UBHizOsfLO7v'], 'uuids': ['fe6f968e-325f-480c-b794-d5ad45164a4a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.174216", "end": "2021-01-27 13:25:55.475117", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PH77JjeCgi6Iq0tkKXaP6UBHizOsfLO7v"], "labels": [], "masters": [], "uuids": ["fe6f968e-325f-480c-b794-d5ad45164a4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:55.300901", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.169201 s, 682 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.169201 s, 682 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:55.798 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:55.988 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr002AYIApWeYkZRQV9wDAwc1mkDuT33Iyyd'], 'uuids': ['8929c498-72c5-431c-b41f-6272498e06cf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.172393", "end": "2021-01-27 13:25:56.230101", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr002AYIApWeYkZRQV9wDAwc1mkDuT33Iyyd"], "labels": [], "masters": [], "uuids": ["8929c498-72c5-431c-b41f-6272498e06cf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:56.057708", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167617 s, 688 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167617 s, 688 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:55.988 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:56.084 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PNCyFZdcXMKvLCpearG4taJsO1rE5yUS3'], 'uuids': ['21346ad4-9ef8-4bb5-a5ba-e1cd501b26e8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158621", "end": "2021-01-27 13:25:55.765928", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-dl1PSpqYEqgI2IuJcsI6SLumf2pBN77PNCyFZdcXMKvLCpearG4taJsO1rE5yUS3"], "labels": [], "masters": [], "uuids": ["21346ad4-9ef8-4bb5-a5ba-e1cd501b26e8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:55.607307", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153841 s, 750 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153841 s, 750 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:56.131 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:01.651) 0:01:24.318 ***** 2021-01-27T13:25:56.285 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00wQdWbdPFlYcLWBAYhZKF4Qfk2JCQjyLI'], 'uuids': ['afb746b6-8294-4102-b83e-3f4a00c62efe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.170711", "end": "2021-01-27 13:25:56.534670", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-QkNfyj3gbbr3QRileGfBjX6TQMnDYr00wQdWbdPFlYcLWBAYhZKF4Qfk2JCQjyLI"], "labels": [], "masters": [], "uuids": ["afb746b6-8294-4102-b83e-3f4a00c62efe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 13:25:56.363959", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.165804 s, 696 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.165804 s, 696 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:56.333 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:00.201) 0:01:24.520 ***** 2021-01-27T13:25:56.424 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-27T13:25:56.426 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.149749", "end": "2021-01-27 13:25:56.108876", "rc": 0, "start": "2021-01-27 13:25:55.959127", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:56.462 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:00.128) 0:01:24.649 ***** 2021-01-27T13:25:56.637 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.161254", "end": "2021-01-27 13:25:56.878342", "rc": 0, "start": "2021-01-27 13:25:56.717088", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:56.673 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:00.211) 0:01:24.860 ***** 2021-01-27T13:25:56.691 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-27T13:25:56.692 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.089027", "end": "2021-01-27 13:25:56.381456", "rc": 0, "start": "2021-01-27 13:25:56.292429", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:56.728 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:00.054) 0:01:24.915 ***** 2021-01-27T13:25:56.755 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-27T13:25:56.794 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:00.065) 0:01:24.981 ***** 2021-01-27T13:25:56.821 INFO:teuthology.task.ansible.out: 2021-01-27T13:25:56.823 INFO:teuthology.task.ansible.out:TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:56.861 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:00.067) 0:01:25.048 ***** 2021-01-27T13:25:56.890 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-27T13:25:56.892 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:56.927 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:00.065) 0:01:25.114 ***** 2021-01-27T13:25:56.934 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-27T13:25:56.935 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.086489", "end": "2021-01-27 13:25:57.142669", "rc": 0, "start": "2021-01-27 13:25:57.056180", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:25:56.971 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:56 +0000 (0:00:00.044) 0:01:25.158 ***** 2021-01-27T13:25:56.985 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.022 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.050) 0:01:25.209 ***** 2021-01-27T13:25:57.028 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-27T13:25:57.070 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.048) 0:01:25.257 ***** 2021-01-27T13:25:57.077 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-27T13:25:57.079 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.116 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.046) 0:01:25.303 ***** 2021-01-27T13:25:57.125 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-27T13:25:57.126 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.181 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.064) 0:01:25.368 ***** 2021-01-27T13:25:57.219 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-27T13:25:57.221 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.256 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.074) 0:01:25.442 ***** 2021-01-27T13:25:57.262 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-27T13:25:57.264 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T13:25:57.300 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.044) 0:01:25.487 ***** 2021-01-27T13:25:57.307 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T13:25:57.309 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.353 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.052) 0:01:25.540 ***** 2021-01-27T13:25:57.361 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T13:25:57.362 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'block_used': 13965194, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129914, 'size_available': 926228127744, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165092, 'block_size': 4096, 'inode_available': 60889884}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129914, "block_size": 4096, "block_total": 240095108, "block_used": 13965194, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889884, "inode_total": 61054976, "inode_used": 165092, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228127744, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.405 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.052) 0:01:25.592 ***** 2021-01-27T13:25:57.413 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-27T13:25:57.415 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.455 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.049) 0:01:25.642 ***** 2021-01-27T13:25:57.461 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.502 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.046) 0:01:25.689 ***** 2021-01-27T13:25:57.540 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:57.542 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.591 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.089) 0:01:25.778 ***** 2021-01-27T13:25:57.599 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-27T13:25:57.600 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T13:25:57.642 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.050) 0:01:25.828 ***** 2021-01-27T13:25:57.648 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:57.650 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.688 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.046) 0:01:25.875 ***** 2021-01-27T13:25:57.695 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T13:25:57.697 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'block_used': 13965190, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129918, 'size_available': 926228144128, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129918, "block_size": 4096, "block_total": 240095108, "block_used": 13965190, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228144128, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.735 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.046) 0:01:25.922 ***** 2021-01-27T13:25:57.741 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-27T13:25:57.743 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.781 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.046) 0:01:25.968 ***** 2021-01-27T13:25:57.789 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.829 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.048) 0:01:26.016 ***** 2021-01-27T13:25:57.835 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-27T13:25:57.837 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.873 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.043) 0:01:26.060 ***** 2021-01-27T13:25:57.880 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:57.881 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.917 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.043) 0:01:26.104 ***** 2021-01-27T13:25:57.923 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-27T13:25:57.924 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:57.961 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:57 +0000 (0:00:00.043) 0:01:26.148 ***** 2021-01-27T13:25:57.967 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:25:57.969 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:58.010 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:58 +0000 (0:00:00.049) 0:01:26.197 ***** 2021-01-27T13:25:58.051 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-27T13:25:58.053 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:58.090 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:58 +0000 (0:00:00.080) 0:01:26.277 ***** 2021-01-27T13:25:58.132 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:58.171 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:58 +0000 (0:00:00.080) 0:01:26.358 ***** 2021-01-27T13:25:58.201 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-27T13:25:58.203 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:25:58.239 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:58 +0000 (0:00:00.068) 0:01:26.426 ***** 2021-01-27T13:25:58.750 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-27T13:25:58.752 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-27T13:25:58.796 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:58 +0000 (0:00:00.556) 0:01:26.982 ***** 2021-01-27T13:25:58.803 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-27T13:25:58.845 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:25:58 +0000 (0:00:00.049) 0:01:27.032 ***** 2021-01-27T13:25:59.466 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-27T13:25:59.468 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:25:59.530 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:25:59.858 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:25:59.924 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:26:00.296 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:26:00.309 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:26:00.704 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:26:00.706 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:26:01.100 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:26:01.104 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:01.160 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:01 +0000 (0:00:02.313) 0:01:29.346 ***** 2021-01-27T13:26:01.172 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T13:26:01.223 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:01 +0000 (0:00:00.063) 0:01:29.410 ***** 2021-01-27T13:26:01.308 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:01.310 INFO:teuthology.task.ansible.out:TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-27T13:26:01.360 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:01 +0000 (0:00:00.136) 0:01:29.546 ***** 2021-01-27T13:26:01.382 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-27T13:26:01.437 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:01 +0000 (0:00:00.077) 0:01:29.624 ***** 2021-01-27T13:26:01.545 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-27T13:26:01.548 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T13:26:01.631 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T13:26:01.675 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T13:26:01.761 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T13:26:01.794 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T13:26:01.879 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T13:26:01.911 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T13:26:01.923 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:01.965 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:01 +0000 (0:00:00.528) 0:01:30.152 ***** 2021-01-27T13:26:02.017 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T13:26:02.039 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:02.085 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.119) 0:01:30.271 ***** 2021-01-27T13:26:02.095 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:02.135 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.050) 0:01:30.322 ***** 2021-01-27T13:26:02.144 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:02.183 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.047) 0:01:30.370 ***** 2021-01-27T13:26:02.191 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-27T13:26:02.193 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:02.232 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.048) 0:01:30.419 ***** 2021-01-27T13:26:02.239 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:02.278 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.045) 0:01:30.465 ***** 2021-01-27T13:26:02.368 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:02.370 INFO:teuthology.task.ansible.out:TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-27T13:26:02.370 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:26:02.410 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.131) 0:01:30.596 ***** 2021-01-27T13:26:02.427 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:26:02.470 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.060) 0:01:30.657 ***** 2021-01-27T13:26:02.477 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-27T13:26:02.479 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-27T13:26:02.533 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.063) 0:01:30.720 ***** 2021-01-27T13:26:02.544 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-27T13:26:02.592 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:02 +0000 (0:00:00.058) 0:01:30.779 ***** 2021-01-27T13:26:03.083 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi037.front.sepia.ceph.com] => {"changed": true} 2021-01-27T13:26:03.128 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:03 +0000 (0:00:00.535) 0:01:31.315 ***** 2021-01-27T13:26:03.141 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true} 2021-01-27T13:26:03.190 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:03 +0000 (0:00:00.061) 0:01:31.377 ***** 2021-01-27T13:26:03.636 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-27T13:26:03.638 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-27T13:26:03.678 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:03 +0000 (0:00:00.487) 0:01:31.865 ***** 2021-01-27T13:26:03.690 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-27T13:26:03.734 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:03 +0000 (0:00:00.056) 0:01:31.921 ***** 2021-01-27T13:26:03.742 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:03.808 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:03 +0000 (0:00:00.074) 0:01:31.995 ***** 2021-01-27T13:26:03.818 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:03.862 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:03 +0000 (0:00:00.053) 0:01:32.049 ***** 2021-01-27T13:26:03.869 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-27T13:26:03.871 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:03.910 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:03 +0000 (0:00:00.048) 0:01:32.097 ***** 2021-01-27T13:26:03.919 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:03.960 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:03 +0000 (0:00:00.050) 0:01:32.147 ***** 2021-01-27T13:26:03.967 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T13:26:03.968 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:04.008 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.047) 0:01:32.195 ***** 2021-01-27T13:26:04.015 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:04.055 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.046) 0:01:32.241 ***** 2021-01-27T13:26:04.060 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T13:26:04.062 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:04.097 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.042) 0:01:32.284 ***** 2021-01-27T13:26:04.106 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:04.147 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.049) 0:01:32.334 ***** 2021-01-27T13:26:04.248 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-01-27T13:26:04.250 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T13:26:04.290 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.141) 0:01:32.477 ***** 2021-01-27T13:26:04.319 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T13:26:04.361 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.071) 0:01:32.548 ***** 2021-01-27T13:26:04.442 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-27T13:26:04.444 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:26:04.482 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.120) 0:01:32.669 ***** 2021-01-27T13:26:04.509 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:26:04.551 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.068) 0:01:32.738 ***** 2021-01-27T13:26:04.833 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-27T13:26:04.835 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-27T13:26:04.876 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.324) 0:01:33.062 ***** 2021-01-27T13:26:04.877 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:04.897 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-27T13:26:04.899 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:04.942 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:04 +0000 (0:00:00.065) 0:01:33.128 ***** 2021-01-27T13:26:05.223 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-01-27T13:26:05.225 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-27T13:26:05.262 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:05 +0000 (0:00:00.319) 0:01:33.448 ***** 2021-01-27T13:26:05.292 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-27T13:26:05.334 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:05 +0000 (0:00:00.072) 0:01:33.521 ***** 2021-01-27T13:26:05.934 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-01-27T13:26:05.936 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:26:05.973 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:05 +0000 (0:00:00.638) 0:01:34.160 ***** 2021-01-27T13:26:05.991 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:26:06.030 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:06 +0000 (0:00:00.057) 0:01:34.217 ***** 2021-01-27T13:26:06.276 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-27T13:26:06.280 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.121643", "end": "2021-01-27 13:26:05.967171", "rc": 0, "start": "2021-01-27 13:26:05.845528", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-27T13:26:06.320 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:06 +0000 (0:00:00.289) 0:01:34.507 ***** 2021-01-27T13:26:06.380 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-27T13:26:06.381 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:06.437 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:06 +0000 (0:00:00.116) 0:01:34.623 ***** 2021-01-27T13:26:06.446 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-27T13:26:06.448 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.124633", "end": "2021-01-27 13:26:06.610066", "rc": 0, "start": "2021-01-27 13:26:06.485433", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-27T13:26:06.503 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:06 +0000 (0:00:00.065) 0:01:34.689 ***** 2021-01-27T13:26:06.537 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-27T13:26:06.539 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:06.591 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:06 +0000 (0:00:00.087) 0:01:34.777 ***** 2021-01-27T13:26:06.598 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-27T13:26:06.605 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:06.644 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:06 +0000 (0:00:00.052) 0:01:34.830 ***** 2021-01-27T13:26:06.697 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-27T13:26:06.699 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:06.734 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:06 +0000 (0:00:00.090) 0:01:34.921 ***** 2021-01-27T13:26:07.293 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-27T13:26:07.295 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:26:07.342 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:07 +0000 (0:00:00.607) 0:01:35.529 ***** 2021-01-27T13:26:07.370 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:07.409 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:07 +0000 (0:00:00.066) 0:01:35.596 ***** 2021-01-27T13:26:07.428 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-27T13:26:07.430 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:26:07.474 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:07 +0000 (0:00:00.064) 0:01:35.661 ***** 2021-01-27T13:26:07.504 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-27T13:26:07.506 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:07.547 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:07 +0000 (0:00:00.073) 0:01:35.734 ***** 2021-01-27T13:26:07.768 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-27T13:26:07.769 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-27T13:26:07.827 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:07 +0000 (0:00:00.279) 0:01:36.013 ***** 2021-01-27T13:26:07.856 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-27T13:26:07.858 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:07.905 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:07 +0000 (0:00:00.078) 0:01:36.092 ***** 2021-01-27T13:26:07.913 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-27T13:26:07.915 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-27T13:26:07.955 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:07 +0000 (0:00:00.049) 0:01:36.142 ***** 2021-01-27T13:26:07.983 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-27T13:26:07.985 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:08.019 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.063) 0:01:36.206 ***** 2021-01-27T13:26:08.111 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-27T13:26:08.112 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 13:24:01 UTC", "ActiveEnterTimestampMonotonic": "18370315", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target sysinit.target -.mount systemd-journald.socket network.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 13:24:01 UTC", "AssertTimestampMonotonic": "18128074", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 13:24:01 UTC", "ConditionTimestampMonotonic": "18128073", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-01-27T13:26:08.114 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "889", "ExecMainStartTimestamp": "Wed 2021-01-27 13:24:01 UTC", "ExecMainStartTimestampMonotonic": "18370284", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 13:24:01 UTC", "InactiveExitTimestampMonotonic": "18129869", "InvocationID": "06a41fc9059a467aa3876a1274cc2769", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-27T13:26:08.115 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127805", "LimitNPROCSoft": "127805", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127805", "LimitSIGPENDINGSoft": "127805", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "889", "MemoryAccounting": "yes", "MemoryCurrent": "3751936", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requi 2021-01-27T13:26:08.117 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 13:24:01 UTC", "StateChangeTimestampMonotonic": "18370315", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38341", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T13:26:08.151 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.132) 0:01:36.338 ***** 2021-01-27T13:26:08.180 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:26:08.181 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-27T13:26:08.218 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.066) 0:01:36.404 ***** 2021-01-27T13:26:08.225 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-27T13:26:08.227 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 13:24:19 UTC", "ActiveEnterTimestampMonotonic": "14583931", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target -.mount network.target basic.target system.slice systemd-journald.socket systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 13:24:19 UTC", "AssertTimestampMonotonic": "14435605", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 13:24:19 UTC", "ConditionTimestampMonotonic": "14435604", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-01-27T13:26:08.229 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "878", "ExecMainStartTimestamp": "Wed 2021-01-27 13:24:19 UTC", "ExecMainStartTimestampMonotonic": "14583910", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 13:24:19 UTC", "InactiveExitTimestampMonotonic": "14436926", "InvocationID": "c313243bfb4443cc94918b41eff2878e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-27T13:26:08.230 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "878", "MemoryAccounting": "yes", "MemoryCurrent": "3690496", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requi 2021-01-27T13:26:08.232 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 13:24:19 UTC", "StateChangeTimestampMonotonic": "14583931", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T13:26:08.265 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.047) 0:01:36.452 ***** 2021-01-27T13:26:08.273 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:26:08.275 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-27T13:26:08.309 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.043) 0:01:36.496 ***** 2021-01-27T13:26:08.317 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:26:08.318 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-27T13:26:08.355 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.046) 0:01:36.542 ***** 2021-01-27T13:26:08.362 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-27T13:26:08.363 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:08.402 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.046) 0:01:36.589 ***** 2021-01-27T13:26:08.413 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T13:26:08.415 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-27T13:26:08.450 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.048) 0:01:36.637 ***** 2021-01-27T13:26:08.477 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-27T13:26:08.479 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:08.512 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:08 +0000 (0:00:00.061) 0:01:36.699 ***** 2021-01-27T13:26:09.665 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:26:09.703 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:09 +0000 (0:00:01.190) 0:01:37.890 ***** 2021-01-27T13:26:09.731 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-27T13:26:09.733 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:09.771 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:09 +0000 (0:00:00.068) 0:01:37.958 ***** 2021-01-27T13:26:09.799 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-27T13:26:09.801 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:26:09.847 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:09 +0000 (0:00:00.075) 0:01:38.034 ***** 2021-01-27T13:26:09.874 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-27T13:26:09.876 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:09.911 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:09 +0000 (0:00:00.063) 0:01:38.098 ***** 2021-01-27T13:26:09.959 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-27T13:26:09.961 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T13:26:09.998 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:09 +0000 (0:00:00.086) 0:01:38.185 ***** 2021-01-27T13:26:10.104 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T13:26:10.142 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:10 +0000 (0:00:00.144) 0:01:38.329 ***** 2021-01-27T13:26:10.478 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-01-27T13:26:10.480 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-27T13:26:10.518 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:10 +0000 (0:00:00.375) 0:01:38.704 ***** 2021-01-27T13:26:10.592 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-27T13:26:10.631 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:10 +0000 (0:00:00.113) 0:01:38.818 ***** 2021-01-27T13:26:13.255 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-27T13:26:13.257 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-27T13:26:13.290 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:13 +0000 (0:00:02.659) 0:01:41.477 ***** 2021-01-27T13:26:13.297 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-27T13:26:13.337 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:13 +0000 (0:00:00.046) 0:01:41.524 ***** 2021-01-27T13:26:13.825 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:13.827 INFO:teuthology.task.ansible.out:TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi037.front.sepia.ceph.com] => {"changed": false} 2021-01-27T13:26:13.863 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:13 +0000 (0:00:00.526) 0:01:42.050 ***** 2021-01-27T13:26:13.871 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false} 2021-01-27T13:26:13.915 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:13 +0000 (0:00:00.051) 0:01:42.102 ***** 2021-01-27T13:26:13.924 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-27T13:26:13.926 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-01-27T13:26:13.964 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:13 +0000 (0:00:00.049) 0:01:42.151 ***** 2021-01-27T13:26:13.971 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-27T13:26:14.011 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.046) 0:01:42.198 ***** 2021-01-27T13:26:14.170 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-27T13:26:14.171 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611753564.6464639, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611753564.642464, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611753564.642464, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-27T13:26:14.222 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.210) 0:01:42.409 ***** 2021-01-27T13:26:14.230 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611753613.492528, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611753613.488528, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611753613.488528, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-27T13:26:14.280 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.058) 0:01:42.467 ***** 2021-01-27T13:26:14.544 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-27T13:26:14.545 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-27T13:26:14.581 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.300) 0:01:42.768 ***** 2021-01-27T13:26:14.621 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.040) 0:01:42.808 ***** 2021-01-27T13:26:14.627 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-27T13:26:14.629 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-27T13:26:14.666 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.045) 0:01:42.853 ***** 2021-01-27T13:26:14.676 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-27T13:26:14.724 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.058) 0:01:42.911 ***** 2021-01-27T13:26:14.733 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-27T13:26:14.734 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:14.771 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.046) 0:01:42.958 ***** 2021-01-27T13:26:14.779 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:14.820 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.048) 0:01:43.006 ***** 2021-01-27T13:26:14.964 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-27T13:26:14.965 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-27T13:26:15.002 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:14 +0000 (0:00:00.182) 0:01:43.189 ***** 2021-01-27T13:26:15.009 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-27T13:26:15.047 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.044) 0:01:43.234 ***** 2021-01-27T13:26:15.179 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-27T13:26:15.180 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-27T13:26:15.217 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.169) 0:01:43.403 ***** 2021-01-27T13:26:15.232 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-27T13:26:15.267 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.050) 0:01:43.454 ***** 2021-01-27T13:26:15.274 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-27T13:26:15.276 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.313 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.045) 0:01:43.500 ***** 2021-01-27T13:26:15.320 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.045) 0:01:43.545 ***** 2021-01-27T13:26:15.365 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-27T13:26:15.367 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.367 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.378 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.416 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.057) 0:01:43.603 ***** 2021-01-27T13:26:15.424 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.426 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.469 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.052) 0:01:43.656 ***** 2021-01-27T13:26:15.475 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-01-27T13:26:15.476 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.478 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi037.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.518 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.048) 0:01:43.704 ***** 2021-01-27T13:26:15.526 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.527 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.529 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.542 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.597 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.079) 0:01:43.784 ***** 2021-01-27T13:26:15.609 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.654 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.056) 0:01:43.841 ***** 2021-01-27T13:26:15.663 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.701 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.047) 0:01:43.888 ***** 2021-01-27T13:26:15.709 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-27T13:26:15.711 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.746 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.044) 0:01:43.933 ***** 2021-01-27T13:26:15.754 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.792 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.045) 0:01:43.979 ***** 2021-01-27T13:26:15.801 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-27T13:26:15.803 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.846 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.054) 0:01:44.033 ***** 2021-01-27T13:26:15.861 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.905 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.058) 0:01:44.092 ***** 2021-01-27T13:26:15.913 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-27T13:26:15.915 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:15.953 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:15 +0000 (0:00:00.046) 0:01:44.139 ***** 2021-01-27T13:26:15.962 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.008 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.056) 0:01:44.195 ***** 2021-01-27T13:26:16.017 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-27T13:26:16.019 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.065 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.057) 0:01:44.252 ***** 2021-01-27T13:26:16.073 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.125 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.060) 0:01:44.312 ***** 2021-01-27T13:26:16.133 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.174 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.048) 0:01:44.361 ***** 2021-01-27T13:26:16.181 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.221 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.046) 0:01:44.408 ***** 2021-01-27T13:26:16.227 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-27T13:26:16.229 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.267 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.046) 0:01:44.454 ***** 2021-01-27T13:26:16.275 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.338 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.070) 0:01:44.524 ***** 2021-01-27T13:26:16.344 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T13:26:16.346 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.385 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.047) 0:01:44.572 ***** 2021-01-27T13:26:16.396 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:16.437 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:16 +0000 (0:00:00.051) 0:01:44.624 ***** 2021-01-27T13:26:16.639 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-27T13:26:16.641 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010979", "end": "2021-01-27 13:26:16.296641", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-27 13:26:16.285662", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:16.686 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010998", "end": "2021-01-27 13:26:16.897791", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-27 13:26:16.886793", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:16.818 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.008854", "end": "2021-01-27 13:26:16.497256", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-27 13:26:16.488402", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:16.861 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.009670", "end": "2021-01-27 13:26:17.100181", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-27 13:26:17.090511", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:17.011 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005702", "end": "2021-01-27 13:26:16.692762", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-27 13:26:16.687060", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:17.022 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005621", "end": "2021-01-27 13:26:17.268228", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-27 13:26:17.262607", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:17.213 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.013663", "end": "2021-01-27 13:26:17.445166", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-27 13:26:17.431503", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:17.253 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:17 +0000 (0:00:00.816) 0:01:45.440 ***** 2021-01-27T13:26:17.267 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019494", "end": "2021-01-27 13:26:16.892380", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-27 13:26:16.872886", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:17.316 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:17 +0000 (0:00:00.062) 0:01:45.503 ***** 2021-01-27T13:26:17.324 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-27T13:26:17.387 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:17 +0000 (0:00:00.071) 0:01:45.574 ***** 2021-01-27T13:26:17.443 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:17 +0000 (0:00:00.055) 0:01:45.630 ***** 2021-01-27T13:26:17.445 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:17.590 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:17.591 INFO:teuthology.task.ansible.out:TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-27T13:26:17.667 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-27T13:26:17.798 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-01-27T13:26:17.855 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:17 +0000 (0:00:00.412) 0:01:46.042 ***** 2021-01-27T13:26:17.900 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:17 +0000 (0:00:00.044) 0:01:46.087 ***** 2021-01-27T13:26:18.966 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi037.front.sepia.ceph.com] 2021-01-27T13:26:19.030 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] 2021-01-27T13:26:19.074 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:19 +0000 (0:00:01.174) 0:01:47.261 ***** 2021-01-27T13:26:19.150 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:19 +0000 (0:00:00.075) 0:01:47.337 ***** 2021-01-27T13:26:19.158 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T13:26:19.160 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-27T13:26:19.198 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:19 +0000 (0:00:00.047) 0:01:47.385 ***** 2021-01-27T13:26:19.206 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-27T13:26:19.249 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:19 +0000 (0:00:00.050) 0:01:47.436 ***** 2021-01-27T13:26:19.257 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T13:26:19.258 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:19.298 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:19 +0000 (0:00:00.048) 0:01:47.485 ***** 2021-01-27T13:26:19.305 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:19.348 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:19 +0000 (0:00:00.050) 0:01:47.535 ***** 2021-01-27T13:26:19.355 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-27T13:26:19.357 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-27T13:26:19.399 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:19 +0000 (0:00:00.050) 0:01:47.586 ***** 2021-01-27T13:26:19.406 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-27T13:26:19.457 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:19 +0000 (0:00:00.057) 0:01:47.643 ***** 2021-01-27T13:26:20.175 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-27T13:26:20.177 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"cache_update_time": 1611753630, "cache_updated": false, "changed": false} 2021-01-27T13:26:20.216 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:20 +0000 (0:00:00.759) 0:01:48.403 ***** 2021-01-27T13:26:20.225 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"cache_update_time": 1611753690, "cache_updated": false, "changed": false} 2021-01-27T13:26:20.271 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:20 +0000 (0:00:00.055) 0:01:48.458 ***** 2021-01-27T13:26:20.273 INFO:teuthology.task.ansible.out: 2021-01-27T13:26:20.285 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T13:26:20.287 INFO:teuthology.task.ansible.out:skipping: [smithi037.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:20.339 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:20 +0000 (0:00:00.067) 0:01:48.526 ***** 2021-01-27T13:26:20.347 INFO:teuthology.task.ansible.out:skipping: [smithi099.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T13:26:20.390 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:20 +0000 (0:00:00.050) 0:01:48.576 ***** 2021-01-27T13:26:20.396 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T13:26:20.398 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-27T13:26:20.439 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:20 +0000 (0:00:00.049) 0:01:48.625 ***** 2021-01-27T13:26:20.446 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-27T13:26:20.490 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:20 +0000 (0:00:00.051) 0:01:48.677 ***** 2021-01-27T13:26:20.693 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-01-27T13:26:20.695 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:26:20.726 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:26:20.863 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:26:20.905 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:20 +0000 (0:00:00.414) 0:01:49.092 ***** 2021-01-27T13:26:20.912 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T13:26:20.954 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:20 +0000 (0:00:00.049) 0:01:49.141 ***** 2021-01-27T13:26:21.424 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-27T13:26:21.428 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611753980.9587314-107435258971546/source", "state": "file", "uid": 0} 2021-01-27T13:26:21.448 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611753981.0003195-159664282187837/source", "state": "file", "uid": 0} 2021-01-27T13:26:21.885 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611753981.4582453-45803613280616/source", "state": "file", "uid": 0} 2021-01-27T13:26:21.887 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611753981.433029-86012106528150/source", "state": "file", "uid": 0} 2021-01-27T13:26:21.926 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:21 +0000 (0:00:00.971) 0:01:50.113 ***** 2021-01-27T13:26:21.963 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:21 +0000 (0:00:00.037) 0:01:50.150 ***** 2021-01-27T13:26:26.838 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-01-27T13:26:26.840 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-yclgd79_\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-yclgd79_"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-yclgd79_\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=82b199cccda3bb704bab3c933ac0a4084995251fbe2bec1b1dc6b2dccc62b286\n Stored in directory: /tmp/pip-ephem-wheel-cache-vro378z6/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=b0925dc16de7e5a94d2ff02d6d6356837b40202e87ef3802ce1da261d3b1dbde\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-27T13:26:26.842 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-yclgd79_", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=82b199cccda3bb704bab3c933ac0a4084995251fbe2bec1b1dc6b2dccc62b286", " Stored in directory: /tmp/pip-ephem-wheel-cache-vro378z6/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=b0925dc16de7e5a94d2ff02d6d6356837b40202e87ef3802ce1da261d3b1dbde", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-27T13:26:26.876 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:26 +0000 (0:00:04.912) 0:01:55.063 ***** 2021-01-27T13:26:27.000 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-n2pgicik\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-n2pgicik"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-n2pgicik\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=82b199cccda3bb704bab3c933ac0a4084995251fbe2bec1b1dc6b2dccc62b286\n Stored in directory: /tmp/pip-ephem-wheel-cache-yxtm27ts/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=55ba64ff62bb00c00e33d8ba5089627f45fb85b7386d00e31672482bf7bdbadf\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-27T13:26:27.002 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-n2pgicik", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=82b199cccda3bb704bab3c933ac0a4084995251fbe2bec1b1dc6b2dccc62b286", " Stored in directory: /tmp/pip-ephem-wheel-cache-yxtm27ts/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=55ba64ff62bb00c00e33d8ba5089627f45fb85b7386d00e31672482bf7bdbadf", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-27T13:26:27.048 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:27 +0000 (0:00:00.171) 0:01:55.235 ***** 2021-01-27T13:26:27.102 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-01-27T13:26:27.104 INFO:teuthology.task.ansible.out:ok: [smithi099.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-27T13:26:27.171 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:27 +0000 (0:00:00.123) 0:01:55.358 ***** 2021-01-27T13:26:27.250 INFO:teuthology.task.ansible.out:ok: [smithi037.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-27T13:26:27.292 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:27 +0000 (0:00:00.120) 0:01:55.479 ***** 2021-01-27T13:26:27.650 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-01-27T13:26:27.652 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611753987.2296867-222384404991018/source", "state": "file", "uid": 0} 2021-01-27T13:26:27.693 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:27 +0000 (0:00:00.400) 0:01:55.879 ***** 2021-01-27T13:26:27.763 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611753987.3312593-253042759357080/source", "state": "file", "uid": 0} 2021-01-27T13:26:27.802 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:27 +0000 (0:00:00.108) 0:01:55.988 ***** 2021-01-27T13:26:27.935 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-27T13:26:27.937 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.037537", "end": "2021-01-27 13:26:28.179754", "rc": 0, "start": "2021-01-27 13:26:28.142217", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:27.988 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:27 +0000 (0:00:00.185) 0:01:56.174 ***** 2021-01-27T13:26:28.030 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.037825", "end": "2021-01-27 13:26:27.720324", "rc": 0, "start": "2021-01-27 13:26:27.682499", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T13:26:28.075 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 13:26:28 +0000 (0:00:00.087) 0:01:56.261 ***** 2021-01-27T13:26:31.457 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-01-27T13:26:31.458 INFO:teuthology.task.ansible.out:changed: [smithi099.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "firewalld.service docker.socket basic.target systemd-journald.socket sysinit.target containerd.service system.slice network-online.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-27T13:26:31.460 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-27T13:26:31.462 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-27T13:26:31.464 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 13:25:19 UTC", "StateChangeTimestampMonotonic": "74376097", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T13:26:31.586 INFO:teuthology.task.ansible.out:changed: [smithi037.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket containerd.service firewalld.service network-online.target sysinit.target system.slice basic.target docker.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-27T13:26:31.588 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-27T13:26:31.590 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127805", "LimitSIGPENDINGSoft": "127805", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-27T13:26:31.592 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 13:25:18 UTC", "StateChangeTimestampMonotonic": "95341440", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T13:26:31.698 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-01-27T13:26:31.703 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-01-27T13:26:31.706 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-01-27T13:26:31.708 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi037.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi099.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Wednesday 27 January 2021 13:26:31 +0000 (0:00:03.632) 0:01:59.894 ***** =============================================================================== testnode : Ensure packages are not present. ---------------------------- 12.07s testnode : Install packages --------------------------------------------- 9.00s testnode : Zap all non-root disks --------------------------------------- 8.23s container-host : Install registries-conf-ctl ---------------------------- 4.91s container-host : Restart docker service --------------------------------- 3.63s common : Update apt cache ----------------------------------------------- 3.21s testnode : Install packages via pip ------------------------------------- 2.66s testnode : Install apt keys --------------------------------------------- 2.33s Gathering Facts --------------------------------------------------------- 2.33s testnode : Create logical volume(s) ------------------------------------- 2.31s testnode : Update apt cache. -------------------------------------------- 2.03s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.65s testnode : Install python-pip on apt based systems. --------------------- 1.19s Gathering Facts --------------------------------------------------------- 1.17s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.98s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 0.97s Gathering Facts --------------------------------------------------------- 0.96s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.90s users 2021-01-27T13:26:31.710 INFO:teuthology.task.ansible.out:: Create all admin users with sudo access. ------------------------ 0.89s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.82s 2021-01-27T13:26:32.078 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com')] 2021-01-27T13:26:32.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:26:32.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:26:32.140 DEBUG:teuthology.orchestra.run.smithi037:> true 2021-01-27T13:26:32.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T13:26:32.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T13:26:32.358 DEBUG:teuthology.orchestra.run.smithi099:> true 2021-01-27T13:26:32.529 INFO:teuthology.run_tasks:Running task clock... 2021-01-27T13:26:32.541 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-01-27T13:26:32.541 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-27T13:26:32.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-27T13:26:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-27T13:26:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: Command line: ntpd -gq 2021-01-27T13:26:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: proto: precision = 0.257 usec (-22) 2021-01-27T13:26:32.577 INFO:teuthology.orchestra.run.smithi037.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T13:26:32.577 INFO:teuthology.orchestra.run.smithi037.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-27T13:26:32.578 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T13:26:32.578 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: restrict ::: KOD does nothing without LIMITED. 2021-01-27T13:26:32.578 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: Listen and drop on 0 v6wildcard [::]:123 2021-01-27T13:26:32.578 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-27T13:26:32.579 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: Listen normally on 2 lo 127.0.0.1:123 2021-01-27T13:26:32.579 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: Listen normally on 3 ens1f0 172.21.15.37:123 2021-01-27T13:26:32.580 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: Listen normally on 4 lo [::1]:123 2021-01-27T13:26:32.580 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe88:7794%4]:123 2021-01-27T13:26:32.580 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:32 ntpd[5338]: Listening on routing socket on fd #22 for interface updates 2021-01-27T13:26:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:33.579 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:33.579 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:33.580 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:33.580 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:33.580 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:33.582 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:33.582 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:33 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:34.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:34 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:34.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:34 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:34.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:34 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:34.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:34 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:34 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:34 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:35.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:35.580 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:35.580 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:35 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:36.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:36.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:36.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:36.579 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:36 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:37.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:37.579 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:37.579 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:37.579 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:37 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:38.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:38.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:38.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:38 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:39.577 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:27 Jan 13:26:39 ntpd[5338]: can't open /var/log/ntpstats/loopstats.20210127: Permission denied 2021-01-27T13:26:39.578 INFO:teuthology.orchestra.run.smithi037.stdout:27 Jan 13:26:39 ntpd[5338]: ntpd: time set +0.286086 s 2021-01-27T13:26:39.578 INFO:teuthology.orchestra.run.smithi037.stdout:ntpd: time set +0.286086s 2021-01-27T13:26:39.635 INFO:teuthology.orchestra.run.smithi037.stdout: remote refid st t when poll reach delay offset jitter 2021-01-27T13:26:39.635 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================== 2021-01-27T13:26:39.635 INFO:teuthology.orchestra.run.smithi037.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T13:26:39.635 INFO:teuthology.orchestra.run.smithi037.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T13:26:39.636 INFO:teuthology.orchestra.run.smithi037.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T13:26:39.636 INFO:teuthology.orchestra.run.smithi037.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T13:26:39.636 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-27T13:26:39.637 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-27T13:26:39.673 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-27T13:26:39.673 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: Command line: ntpd -gq 2021-01-27T13:26:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: proto: precision = 0.084 usec (-23) 2021-01-27T13:26:39.675 INFO:teuthology.orchestra.run.smithi099.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T13:26:39.675 INFO:teuthology.orchestra.run.smithi099.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-27T13:26:39.675 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T13:26:39.676 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: restrict ::: KOD does nothing without LIMITED. 2021-01-27T13:26:39.676 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: Listen and drop on 0 v6wildcard [::]:123 2021-01-27T13:26:39.676 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-27T13:26:39.676 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: Listen normally on 2 lo 127.0.0.1:123 2021-01-27T13:26:39.677 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: Listen normally on 3 enp3s0f1 172.21.15.99:123 2021-01-27T13:26:39.677 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: Listen normally on 4 lo [::1]:123 2021-01-27T13:26:39.677 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d803%5]:123 2021-01-27T13:26:39.677 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:39 ntpd[5409]: Listening on routing socket on fd #22 for interface updates 2021-01-27T13:26:40.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:40 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:40.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:40 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:40.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:40 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:40.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:40 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:40.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:40 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:40.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:40 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:41 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:41 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:41 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:41 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:41 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:41 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:42.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:42 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:42.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:42 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:42.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:42 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:42.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:42 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:42.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:42 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:42.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:42 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:43.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:43.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:43 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:44.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:44.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:44.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:44.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:44.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:44.678 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:44.678 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:44.678 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:44.679 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:44.679 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:44.680 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:44.680 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:44 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:45.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:45.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:45.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:45.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:45.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:45.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:45.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:45.678 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:45.678 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:45 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:46.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:46.675 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:46.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:46.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:46.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T13:26:46.676 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T13:26:46.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T13:26:46.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T13:26:46.677 INFO:teuthology.orchestra.run.smithi099.stderr:27 Jan 13:26:46 ntpd[5409]: can't open /var/log/ntpstats/loopstats.20210127: Permission denied 2021-01-27T13:26:46.677 INFO:teuthology.orchestra.run.smithi099.stdout:27 Jan 13:26:46 ntpd[5409]: ntpd: time set -0.273775 s 2021-01-27T13:26:46.678 INFO:teuthology.orchestra.run.smithi099.stdout:ntpd: time set -0.273775s 2021-01-27T13:26:46.761 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2021-01-27T13:26:46.762 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2021-01-27T13:26:46.762 INFO:teuthology.orchestra.run.smithi099.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T13:26:46.763 INFO:teuthology.orchestra.run.smithi099.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T13:26:46.763 INFO:teuthology.orchestra.run.smithi099.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T13:26:46.763 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T13:26:46.765 INFO:teuthology.run_tasks:Running task install... 2021-01-27T13:26:46.779 DEBUG:teuthology.task.install:project ceph 2021-01-27T13:26:46.781 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '507028cb839c25d6666833702df6325fd8569096'}} 2021-01-27T13:26:46.781 DEBUG:teuthology.task.install:config {'sha1': '507028cb839c25d6666833702df6325fd8569096'} 2021-01-27T13:26:46.782 INFO:teuthology.task.install:Using flavor: basic 2021-01-27T13:26:46.792 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-01-27T13:26:46.793 INFO:teuthology.task.install:extra packages: [] 2021-01-27T13:26:46.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2021-01-27T13:26:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:Ubuntu 2021-01-27T13:26:46.853 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T13:26:46.854 DEBUG:teuthology.orchestra.run.smithi099:> sudo lsb_release -is 2021-01-27T13:26:46.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-key list | grep Ceph 2021-01-27T13:26:46.914 INFO:teuthology.orchestra.run.smithi099.stdout:Ubuntu 2021-01-27T13:26:46.919 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T13:26:46.920 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-key list | grep Ceph 2021-01-27T13:26:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-27T13:26:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-27T13:26:47.035 INFO:teuthology.orchestra.run.smithi037.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-27T13:26:47.035 INFO:teuthology.orchestra.run.smithi037.stdout:uid [ unknown] Ceph.com (release key) 2021-01-27T13:26:47.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2021-01-27T13:26:47.078 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-27T13:26:47.078 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph.com (release key) 2021-01-27T13:26:47.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo lsb_release -is 2021-01-27T13:26:47.095 INFO:teuthology.orchestra.run.smithi037.stdout:Ubuntu 2021-01-27T13:26:47.100 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T13:26:47.101 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-27T13:26:47.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:26:47.126 INFO:teuthology.orchestra.run.smithi099.stdout:Ubuntu 2021-01-27T13:26:47.131 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T13:26:47.132 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-27T13:26:47.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:26:47.291 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default/ 2021-01-27T13:26:47.291 INFO:teuthology.task.install.deb:Package version is 17.0.0-184-g507028cb-1focal 2021-01-27T13:26:47.295 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default/ 2021-01-27T13:26:47.296 INFO:teuthology.task.install.deb:Package version is 17.0.0-184-g507028cb-1focal 2021-01-27T13:26:47.427 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:26:47.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-27T13:26:47.435 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:26:47.436 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-27T13:26:47.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2021-01-27T13:26:47.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2021-01-27T13:26:47.639 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T13:26:47.695 INFO:teuthology.orchestra.run.smithi037.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal InRelease 2021-01-27T13:26:47.706 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal InRelease 2021-01-27T13:26:47.719 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-27T13:26:47.730 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-27T13:26:47.744 INFO:teuthology.orchestra.run.smithi037.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release.gpg 2021-01-27T13:26:47.746 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T13:26:47.755 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release.gpg 2021-01-27T13:26:47.767 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-01-27T13:26:47.769 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T13:26:47.769 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T13:26:47.791 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-27T13:26:47.812 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-27T13:26:47.829 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T13:26:47.835 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T13:26:47.855 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-01-27T13:26:47.909 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T13:26:47.914 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T13:26:48.326 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 27.3 kB in 1s (40.6 kB/s) 2021-01-27T13:26:48.396 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 27.3 kB in 1s (37.0 kB/s) 2021-01-27T13:26:49.070 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2021-01-27T13:26:49.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-184-g507028cb-1focal cephadm=17.0.0-184-g507028cb-1focal ceph-mds=17.0.0-184-g507028cb-1focal ceph-mgr=17.0.0-184-g507028cb-1focal ceph-common=17.0.0-184-g507028cb-1focal ceph-fuse=17.0.0-184-g507028cb-1focal ceph-test=17.0.0-184-g507028cb-1focal radosgw=17.0.0-184-g507028cb-1focal python3-rados=17.0.0-184-g507028cb-1focal python3-rgw=17.0.0-184-g507028cb-1focal python3-cephfs=17.0.0-184-g507028cb-1focal python3-rbd=17.0.0-184-g507028cb-1focal libcephfs2=17.0.0-184-g507028cb-1focal libcephfs-dev=17.0.0-184-g507028cb-1focal librados2=17.0.0-184-g507028cb-1focal librbd1=17.0.0-184-g507028cb-1focal rbd-fuse=17.0.0-184-g507028cb-1focal 2021-01-27T13:26:49.114 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-01-27T13:26:49.134 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-184-g507028cb-1focal cephadm=17.0.0-184-g507028cb-1focal ceph-mds=17.0.0-184-g507028cb-1focal ceph-mgr=17.0.0-184-g507028cb-1focal ceph-common=17.0.0-184-g507028cb-1focal ceph-fuse=17.0.0-184-g507028cb-1focal ceph-test=17.0.0-184-g507028cb-1focal radosgw=17.0.0-184-g507028cb-1focal python3-rados=17.0.0-184-g507028cb-1focal python3-rgw=17.0.0-184-g507028cb-1focal python3-cephfs=17.0.0-184-g507028cb-1focal python3-rbd=17.0.0-184-g507028cb-1focal libcephfs2=17.0.0-184-g507028cb-1focal libcephfs-dev=17.0.0-184-g507028cb-1focal librados2=17.0.0-184-g507028cb-1focal librbd1=17.0.0-184-g507028cb-1focal rbd-fuse=17.0.0-184-g507028cb-1focal 2021-01-27T13:26:49.163 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2021-01-27T13:26:49.199 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2021-01-27T13:26:49.319 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2021-01-27T13:26:49.319 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2021-01-27T13:26:49.350 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2021-01-27T13:26:49.350 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2021-01-27T13:26:49.459 INFO:teuthology.orchestra.run.smithi037.stdout:The following package was automatically installed and is no longer required: 2021-01-27T13:26:49.463 INFO:teuthology.orchestra.run.smithi037.stdout: libboost-iostreams1.71.0 2021-01-27T13:26:49.464 INFO:teuthology.orchestra.run.smithi037.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T13:26:49.464 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2021-01-27T13:26:49.465 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-27T13:26:49.465 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-27T13:26:49.465 INFO:teuthology.orchestra.run.smithi037.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T13:26:49.466 INFO:teuthology.orchestra.run.smithi037.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T13:26:49.466 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T13:26:49.467 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T13:26:49.467 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-27T13:26:49.468 INFO:teuthology.orchestra.run.smithi037.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-27T13:26:49.468 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-27T13:26:49.468 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-27T13:26:49.469 INFO:teuthology.orchestra.run.smithi037.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-27T13:26:49.469 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T13:26:49.470 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-27T13:26:49.470 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-27T13:26:49.470 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-27T13:26:49.471 INFO:teuthology.orchestra.run.smithi037.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-27T13:26:49.471 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-27T13:26:49.472 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-27T13:26:49.472 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2021-01-27T13:26:49.472 INFO:teuthology.orchestra.run.smithi037.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-27T13:26:49.473 INFO:teuthology.orchestra.run.smithi037.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-27T13:26:49.473 INFO:teuthology.orchestra.run.smithi037.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-27T13:26:49.474 INFO:teuthology.orchestra.run.smithi037.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-27T13:26:49.474 INFO:teuthology.orchestra.run.smithi037.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-27T13:26:49.474 INFO:teuthology.orchestra.run.smithi037.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-27T13:26:49.475 INFO:teuthology.orchestra.run.smithi037.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-27T13:26:49.475 INFO:teuthology.orchestra.run.smithi037.stdout:Recommended packages: 2021-01-27T13:26:49.476 INFO:teuthology.orchestra.run.smithi037.stdout: btrfs-tools 2021-01-27T13:26:49.486 INFO:teuthology.orchestra.run.smithi099.stdout:The following package was automatically installed and is no longer required: 2021-01-27T13:26:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.71.0 2021-01-27T13:26:49.488 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T13:26:49.488 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2021-01-27T13:26:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-27T13:26:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-27T13:26:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T13:26:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T13:26:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T13:26:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T13:26:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-27T13:26:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-27T13:26:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-27T13:26:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-27T13:26:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-27T13:26:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T13:26:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-27T13:26:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-27T13:26:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-27T13:26:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-27T13:26:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-27T13:26:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-27T13:26:49.493 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2021-01-27T13:26:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-27T13:26:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-27T13:26:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-27T13:26:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-27T13:26:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-27T13:26:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-27T13:26:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-27T13:26:49.495 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2021-01-27T13:26:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: btrfs-tools 2021-01-27T13:26:49.559 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2021-01-27T13:26:49.559 INFO:teuthology.orchestra.run.smithi037.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-27T13:26:49.559 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-27T13:26:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-27T13:26:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-27T13:26:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-27T13:26:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-27T13:26:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-27T13:26:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-27T13:26:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-27T13:26:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-27T13:26:49.562 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-27T13:26:49.562 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-27T13:26:49.562 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-27T13:26:49.563 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T13:26:49.563 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-27T13:26:49.563 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-27T13:26:49.564 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-27T13:26:49.564 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-27T13:26:49.564 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-27T13:26:49.565 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-27T13:26:49.566 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse socat xmlstarlet 2021-01-27T13:26:49.566 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages will be upgraded: 2021-01-27T13:26:49.566 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 librbd1 2021-01-27T13:26:49.585 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2021-01-27T13:26:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-27T13:26:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-27T13:26:49.586 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-27T13:26:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-27T13:26:49.587 INFO:teuthology.orchestra.run.smithi099.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-27T13:26:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-27T13:26:49.589 INFO:teuthology.orchestra.run.smithi099.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-27T13:26:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-27T13:26:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-27T13:26:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-27T13:26:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-27T13:26:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-27T13:26:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-27T13:26:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T13:26:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-27T13:26:49.591 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-27T13:26:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-27T13:26:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-27T13:26:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-27T13:26:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-27T13:26:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse socat xmlstarlet 2021-01-27T13:26:49.593 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2021-01-27T13:26:49.593 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 librbd1 2021-01-27T13:26:49.700 INFO:teuthology.orchestra.run.smithi037.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T13:26:49.700 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 169 MB of archives. 2021-01-27T13:26:49.701 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-27T13:26:49.701 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-184-g507028cb-1focal [3,716 B] 2021-01-27T13:26:49.724 INFO:teuthology.orchestra.run.smithi099.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T13:26:49.725 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 169 MB of archives. 2021-01-27T13:26:49.725 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-27T13:26:49.725 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-184-g507028cb-1focal [3,716 B] 2021-01-27T13:26:49.743 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-27T13:26:49.748 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-184-g507028cb-1focal [3,291 kB] 2021-01-27T13:26:49.771 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-27T13:26:49.772 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-184-g507028cb-1focal [3,291 kB] 2021-01-27T13:26:49.986 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-184-g507028cb-1focal [3,345 kB] 2021-01-27T13:26:50.091 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-27T13:26:50.099 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-27T13:26:50.101 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-27T13:26:50.132 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-27T13:26:50.136 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-184-g507028cb-1focal [705 kB] 2021-01-27T13:26:50.139 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-27T13:26:50.140 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-27T13:26:50.159 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-184-g507028cb-1focal [3,345 kB] 2021-01-27T13:26:50.165 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-184-g507028cb-1focal [409 kB] 2021-01-27T13:26:50.183 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-184-g507028cb-1focal [21.7 kB] 2021-01-27T13:26:50.184 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-184-g507028cb-1focal [197 kB] 2021-01-27T13:26:50.190 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-184-g507028cb-1focal [29.4 kB] 2021-01-27T13:26:50.191 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-184-g507028cb-1focal [385 kB] 2021-01-27T13:26:50.209 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-184-g507028cb-1focal [3,501 kB] 2021-01-27T13:26:50.227 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-27T13:26:50.269 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-27T13:26:50.270 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-27T13:26:50.276 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-27T13:26:50.283 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-27T13:26:50.288 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-27T13:26:50.305 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-27T13:26:50.312 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-27T13:26:50.313 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-27T13:26:50.315 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-27T13:26:50.317 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-27T13:26:50.318 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-27T13:26:50.322 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-27T13:26:50.327 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-27T13:26:50.328 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-27T13:26:50.348 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-27T13:26:50.349 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-184-g507028cb-1focal [116 kB] 2021-01-27T13:26:50.350 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-27T13:26:50.351 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-27T13:26:50.358 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-184-g507028cb-1focal [446 kB] 2021-01-27T13:26:50.359 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-27T13:26:50.365 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-27T13:26:50.377 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-184-g507028cb-1focal [22.0 MB] 2021-01-27T13:26:50.408 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-27T13:26:50.411 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-27T13:26:50.413 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-27T13:26:50.418 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-27T13:26:50.422 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-27T13:26:50.423 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-27T13:26:50.439 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-27T13:26:50.444 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-27T13:26:50.446 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-27T13:26:50.447 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-27T13:26:50.448 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-27T13:26:50.449 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-27T13:26:50.450 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-27T13:26:50.454 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-27T13:26:50.455 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-27T13:26:50.480 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-27T13:26:50.481 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-27T13:26:50.482 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-27T13:26:50.492 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-27T13:26:50.524 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-27T13:26:50.527 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-27T13:26:50.531 INFO:teuthology.orchestra.run.smithi037.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-27T13:26:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-27T13:26:50.541 INFO:teuthology.orchestra.run.smithi037.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-27T13:26:50.542 INFO:teuthology.orchestra.run.smithi037.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-27T13:26:50.546 INFO:teuthology.orchestra.run.smithi037.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-27T13:26:50.548 INFO:teuthology.orchestra.run.smithi037.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-27T13:26:50.551 INFO:teuthology.orchestra.run.smithi037.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-27T13:26:50.552 INFO:teuthology.orchestra.run.smithi037.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-27T13:26:50.573 INFO:teuthology.orchestra.run.smithi037.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-27T13:26:50.602 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-27T13:26:50.605 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-27T13:26:50.606 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-27T13:26:50.609 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-27T13:26:50.611 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-27T13:26:50.614 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-27T13:26:50.614 INFO:teuthology.orchestra.run.smithi099.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-27T13:26:50.614 INFO:teuthology.orchestra.run.smithi099.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-27T13:26:50.730 INFO:teuthology.orchestra.run.smithi037.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-184-g507028cb-1focal [705 kB] 2021-01-27T13:26:50.864 INFO:teuthology.orchestra.run.smithi037.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-27T13:26:50.874 INFO:teuthology.orchestra.run.smithi037.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-184-g507028cb-1focal [409 kB] 2021-01-27T13:26:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-27T13:26:50.939 INFO:teuthology.orchestra.run.smithi037.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-27T13:26:50.940 INFO:teuthology.orchestra.run.smithi099.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-27T13:26:50.972 INFO:teuthology.orchestra.run.smithi099.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-27T13:26:50.974 INFO:teuthology.orchestra.run.smithi099.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-27T13:26:50.986 INFO:teuthology.orchestra.run.smithi037.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-27T13:26:50.987 INFO:teuthology.orchestra.run.smithi037.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-27T13:26:50.987 INFO:teuthology.orchestra.run.smithi037.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-27T13:26:50.988 INFO:teuthology.orchestra.run.smithi037.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-27T13:26:50.989 INFO:teuthology.orchestra.run.smithi037.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-27T13:26:50.989 INFO:teuthology.orchestra.run.smithi037.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-27T13:26:50.989 INFO:teuthology.orchestra.run.smithi037.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-27T13:26:51.009 INFO:teuthology.orchestra.run.smithi037.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-184-g507028cb-1focal [21.7 kB] 2021-01-27T13:26:51.013 INFO:teuthology.orchestra.run.smithi037.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-184-g507028cb-1focal [197 kB] 2021-01-27T13:26:51.030 INFO:teuthology.orchestra.run.smithi037.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-27T13:26:51.031 INFO:teuthology.orchestra.run.smithi037.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-184-g507028cb-1focal [29.4 kB] 2021-01-27T13:26:51.031 INFO:teuthology.orchestra.run.smithi037.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-184-g507028cb-1focal [385 kB] 2021-01-27T13:26:51.034 INFO:teuthology.orchestra.run.smithi037.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-27T13:26:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-27T13:26:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-27T13:26:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-27T13:26:51.044 INFO:teuthology.orchestra.run.smithi099.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-27T13:26:51.045 INFO:teuthology.orchestra.run.smithi099.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-27T13:26:51.045 INFO:teuthology.orchestra.run.smithi099.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-27T13:26:51.046 INFO:teuthology.orchestra.run.smithi099.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-27T13:26:51.097 INFO:teuthology.orchestra.run.smithi099.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-27T13:26:51.102 INFO:teuthology.orchestra.run.smithi099.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-27T13:26:51.108 INFO:teuthology.orchestra.run.smithi037.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-27T13:26:51.109 INFO:teuthology.orchestra.run.smithi037.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-27T13:26:51.112 INFO:teuthology.orchestra.run.smithi037.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-27T13:26:51.115 INFO:teuthology.orchestra.run.smithi037.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-27T13:26:51.117 INFO:teuthology.orchestra.run.smithi037.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-27T13:26:51.122 INFO:teuthology.orchestra.run.smithi037.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-27T13:26:51.124 INFO:teuthology.orchestra.run.smithi037.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-27T13:26:51.126 INFO:teuthology.orchestra.run.smithi037.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-27T13:26:51.176 INFO:teuthology.orchestra.run.smithi099.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-27T13:26:51.176 INFO:teuthology.orchestra.run.smithi099.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-27T13:26:51.179 INFO:teuthology.orchestra.run.smithi099.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-27T13:26:51.182 INFO:teuthology.orchestra.run.smithi099.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-27T13:26:51.184 INFO:teuthology.orchestra.run.smithi099.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-27T13:26:51.189 INFO:teuthology.orchestra.run.smithi037.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-27T13:26:51.189 INFO:teuthology.orchestra.run.smithi037.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-27T13:26:51.190 INFO:teuthology.orchestra.run.smithi099.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-27T13:26:51.192 INFO:teuthology.orchestra.run.smithi099.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-27T13:26:51.194 INFO:teuthology.orchestra.run.smithi099.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-27T13:26:51.218 INFO:teuthology.orchestra.run.smithi037.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-184-g507028cb-1focal [3,501 kB] 2021-01-27T13:26:51.254 INFO:teuthology.orchestra.run.smithi099.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-27T13:26:51.255 INFO:teuthology.orchestra.run.smithi099.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-27T13:26:51.267 INFO:teuthology.orchestra.run.smithi037.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-27T13:26:51.269 INFO:teuthology.orchestra.run.smithi037.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-27T13:26:51.289 INFO:teuthology.orchestra.run.smithi037.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-27T13:26:51.289 INFO:teuthology.orchestra.run.smithi037.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-27T13:26:51.290 INFO:teuthology.orchestra.run.smithi037.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-27T13:26:51.291 INFO:teuthology.orchestra.run.smithi037.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-27T13:26:51.291 INFO:teuthology.orchestra.run.smithi037.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-27T13:26:51.292 INFO:teuthology.orchestra.run.smithi037.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-27T13:26:51.332 INFO:teuthology.orchestra.run.smithi099.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-27T13:26:51.337 INFO:teuthology.orchestra.run.smithi099.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-27T13:26:51.338 INFO:teuthology.orchestra.run.smithi099.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-184-g507028cb-1focal [5,866 kB] 2021-01-27T13:26:51.346 INFO:teuthology.orchestra.run.smithi037.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-27T13:26:51.347 INFO:teuthology.orchestra.run.smithi037.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-27T13:26:51.356 INFO:teuthology.orchestra.run.smithi099.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-27T13:26:51.356 INFO:teuthology.orchestra.run.smithi099.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-27T13:26:51.357 INFO:teuthology.orchestra.run.smithi099.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-27T13:26:51.357 INFO:teuthology.orchestra.run.smithi099.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-27T13:26:51.358 INFO:teuthology.orchestra.run.smithi099.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-27T13:26:51.359 INFO:teuthology.orchestra.run.smithi099.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-27T13:26:51.411 INFO:teuthology.orchestra.run.smithi099.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-27T13:26:51.412 INFO:teuthology.orchestra.run.smithi099.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-27T13:26:51.486 INFO:teuthology.orchestra.run.smithi099.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-184-g507028cb-1focal [181 kB] 2021-01-27T13:26:51.491 INFO:teuthology.orchestra.run.smithi099.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-184-g507028cb-1focal [1,460 kB] 2021-01-27T13:26:51.547 INFO:teuthology.orchestra.run.smithi099.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-184-g507028cb-1focal [6,916 kB] 2021-01-27T13:26:51.810 INFO:teuthology.orchestra.run.smithi099.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-184-g507028cb-1focal [25.9 MB] 2021-01-27T13:26:51.852 INFO:teuthology.orchestra.run.smithi037.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-184-g507028cb-1focal [116 kB] 2021-01-27T13:26:51.856 INFO:teuthology.orchestra.run.smithi037.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-184-g507028cb-1focal [446 kB] 2021-01-27T13:26:51.979 INFO:teuthology.orchestra.run.smithi037.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-184-g507028cb-1focal [22.0 MB] 2021-01-27T13:26:52.907 INFO:teuthology.orchestra.run.smithi099.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-184-g507028cb-1focal [3,804 B] 2021-01-27T13:26:52.908 INFO:teuthology.orchestra.run.smithi099.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-184-g507028cb-1focal [808 kB] 2021-01-27T13:26:52.912 INFO:teuthology.orchestra.run.smithi099.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-184-g507028cb-1focal [2,304 kB] 2021-01-27T13:26:52.929 INFO:teuthology.orchestra.run.smithi099.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-184-g507028cb-1focal [61.6 kB] 2021-01-27T13:26:52.930 INFO:teuthology.orchestra.run.smithi099.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-184-g507028cb-1focal [63.9 kB] 2021-01-27T13:26:52.954 INFO:teuthology.orchestra.run.smithi099.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-184-g507028cb-1focal [2,327 kB] 2021-01-27T13:26:53.010 INFO:teuthology.orchestra.run.smithi099.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-184-g507028cb-1focal [7,896 kB] 2021-01-27T13:26:53.314 INFO:teuthology.orchestra.run.smithi099.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-184-g507028cb-1focal [3,920 B] 2021-01-27T13:26:53.315 INFO:teuthology.orchestra.run.smithi099.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-184-g507028cb-1focal [22.6 kB] 2021-01-27T13:26:53.315 INFO:teuthology.orchestra.run.smithi099.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-184-g507028cb-1focal [48.1 MB] 2021-01-27T13:26:55.386 INFO:teuthology.orchestra.run.smithi099.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-184-g507028cb-1focal [19.8 kB] 2021-01-27T13:26:55.387 INFO:teuthology.orchestra.run.smithi099.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-184-g507028cb-1focal [10.7 MB] 2021-01-27T13:26:55.654 INFO:teuthology.orchestra.run.smithi099.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-184-g507028cb-1focal [77.7 kB] 2021-01-27T13:26:56.165 INFO:teuthology.orchestra.run.smithi037.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-184-g507028cb-1focal [5,866 kB] 2021-01-27T13:26:56.265 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 169 MB in 6s (27.9 MB/s) 2021-01-27T13:26:56.367 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjaeger. 2021-01-27T13:26:56.427 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-27T13:26:56.431 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../00-libjaeger_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:26:56.494 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:26:56.559 INFO:teuthology.orchestra.run.smithi037.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-184-g507028cb-1focal [181 kB] 2021-01-27T13:26:56.562 INFO:teuthology.orchestra.run.smithi037.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-184-g507028cb-1focal [1,460 kB] 2021-01-27T13:26:56.673 INFO:teuthology.orchestra.run.smithi037.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-184-g507028cb-1focal [6,916 kB] 2021-01-27T13:26:56.967 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-27T13:26:56.985 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-27T13:26:57.067 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T13:26:57.153 INFO:teuthology.orchestra.run.smithi037.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-184-g507028cb-1focal [25.9 MB] 2021-01-27T13:26:57.405 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../02-librbd1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:26:57.529 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librbd1 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T13:26:58.187 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../03-librados2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:26:58.308 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librados2 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T13:26:58.877 INFO:teuthology.orchestra.run.smithi037.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-184-g507028cb-1focal [3,804 B] 2021-01-27T13:26:58.878 INFO:teuthology.orchestra.run.smithi037.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-184-g507028cb-1focal [808 kB] 2021-01-27T13:26:58.890 INFO:teuthology.orchestra.run.smithi037.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-184-g507028cb-1focal [2,304 kB] 2021-01-27T13:26:58.962 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs2. 2021-01-27T13:26:58.980 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:26:59.020 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:26:59.022 INFO:teuthology.orchestra.run.smithi037.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-184-g507028cb-1focal [61.6 kB] 2021-01-27T13:26:59.024 INFO:teuthology.orchestra.run.smithi037.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-184-g507028cb-1focal [63.9 kB] 2021-01-27T13:26:59.037 INFO:teuthology.orchestra.run.smithi037.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-184-g507028cb-1focal [2,327 kB] 2021-01-27T13:26:59.160 INFO:teuthology.orchestra.run.smithi037.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-184-g507028cb-1focal [7,896 kB] 2021-01-27T13:26:59.348 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rados. 2021-01-27T13:26:59.365 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../05-python3-rados_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:26:59.406 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:26:59.609 INFO:teuthology.orchestra.run.smithi037.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-184-g507028cb-1focal [3,920 B] 2021-01-27T13:26:59.609 INFO:teuthology.orchestra.run.smithi037.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-184-g507028cb-1focal [22.6 kB] 2021-01-27T13:26:59.610 INFO:teuthology.orchestra.run.smithi037.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-184-g507028cb-1focal [48.1 MB] 2021-01-27T13:26:59.758 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-27T13:26:59.775 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:26:59.817 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:00.069 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cephfs. 2021-01-27T13:27:00.080 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:00.119 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:00.422 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-27T13:27:00.438 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:00.480 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:00.762 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-prettytable. 2021-01-27T13:27:00.776 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-27T13:27:00.808 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-27T13:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rbd. 2021-01-27T13:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:01.530 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-27T13:27:01.549 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-27T13:27:01.588 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T13:27:01.891 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-27T13:27:01.907 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-27T13:27:01.949 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T13:27:02.260 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librgw2. 2021-01-27T13:27:02.277 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../13-librgw2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:02.301 INFO:teuthology.orchestra.run.smithi037.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-184-g507028cb-1focal [19.8 kB] 2021-01-27T13:27:02.302 INFO:teuthology.orchestra.run.smithi037.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-184-g507028cb-1focal [10.7 MB] 2021-01-27T13:27:02.318 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-184-g507028cb-1focal [77.7 kB] 2021-01-27T13:27:02.896 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rgw. 2021-01-27T13:27:02.913 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:02.953 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:03.281 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-27T13:27:03.300 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-27T13:27:03.336 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 169 MB in 13s (12.9 MB/s) 2021-01-27T13:27:03.339 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T13:27:03.456 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjaeger. 2021-01-27T13:27:03.516 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-27T13:27:03.521 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../00-libjaeger_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:03.563 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:03.684 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liboath0. 2021-01-27T13:27:03.701 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-27T13:27:03.733 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-27T13:27:03.891 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-27T13:27:03.909 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-27T13:27:03.991 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T13:27:04.053 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libradosstriper1. 2021-01-27T13:27:04.070 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:04.111 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:04.320 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../02-librbd1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:04.444 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librbd1 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T13:27:04.565 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-common. 2021-01-27T13:27:04.581 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../18-ceph-common_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:04.623 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:05.232 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../03-librados2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:05.340 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librados2 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T13:27:05.994 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libcephfs2. 2021-01-27T13:27:06.011 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:06.052 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:06.413 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rados. 2021-01-27T13:27:06.429 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../05-python3-rados_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:06.471 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:06.824 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-27T13:27:06.841 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:06.853 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-base. 2021-01-27T13:27:06.872 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../19-ceph-base_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:06.882 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:06.922 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:07.118 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cephfs. 2021-01-27T13:27:07.134 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:07.168 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:07.453 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-27T13:27:07.474 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:07.512 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:07.857 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-prettytable. 2021-01-27T13:27:07.874 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-27T13:27:07.890 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-openssl. 2021-01-27T13:27:07.908 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-27T13:27:07.914 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-27T13:27:07.949 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-27T13:27:08.167 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rbd. 2021-01-27T13:27:08.184 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-27T13:27:08.186 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:08.204 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:08.225 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:08.553 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-27T13:27:08.570 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-27T13:27:08.581 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-27T13:27:08.598 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-27T13:27:08.603 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T13:27:08.639 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T13:27:08.931 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-27T13:27:08.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-27T13:27:08.949 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-27T13:27:08.960 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-27T13:27:08.999 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-27T13:27:09.014 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T13:27:09.320 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-logutils. 2021-01-27T13:27:09.340 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-27T13:27:09.350 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librgw2. 2021-01-27T13:27:09.368 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../13-librgw2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:09.378 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-27T13:27:09.408 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:09.681 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-27T13:27:09.697 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-27T13:27:09.747 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-27T13:27:09.994 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rgw. 2021-01-27T13:27:10.011 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:10.052 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-mako. 2021-01-27T13:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-27T13:27:10.133 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T13:27:10.380 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-27T13:27:10.397 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-27T13:27:10.430 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T13:27:10.469 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-27T13:27:10.488 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-27T13:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-27T13:27:10.783 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liboath0. 2021-01-27T13:27:10.801 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-27T13:27:10.831 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-27T13:27:10.842 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-27T13:27:10.847 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-27T13:27:10.888 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T13:27:11.152 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libradosstriper1. 2021-01-27T13:27:11.169 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:11.191 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webob. 2021-01-27T13:27:11.209 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-27T13:27:11.210 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:11.249 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-27T13:27:11.611 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-27T13:27:11.622 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-common. 2021-01-27T13:27:11.629 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-27T13:27:11.642 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../18-ceph-common_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:11.669 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T13:27:11.672 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:11.988 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bs4. 2021-01-27T13:27:12.005 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-27T13:27:12.046 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-27T13:27:12.408 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-waitress. 2021-01-27T13:27:12.425 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-27T13:27:12.469 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-27T13:27:12.803 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempita. 2021-01-27T13:27:12.819 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-27T13:27:12.861 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-27T13:27:13.163 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-paste. 2021-01-27T13:27:13.184 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-27T13:27:13.221 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T13:27:13.516 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-27T13:27:13.533 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-27T13:27:13.574 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T13:27:13.877 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-27T13:27:13.895 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-27T13:27:13.927 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-base. 2021-01-27T13:27:13.935 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-27T13:27:13.947 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../19-ceph-base_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:13.996 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:14.238 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webtest. 2021-01-27T13:27:14.255 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-27T13:27:14.296 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-27T13:27:14.658 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pecan. 2021-01-27T13:27:14.676 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-27T13:27:14.724 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T13:27:14.965 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-openssl. 2021-01-27T13:27:14.985 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-27T13:27:15.023 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-27T13:27:15.080 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-27T13:27:15.258 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-27T13:27:15.259 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-27T13:27:15.259 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T13:27:15.259 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:15.300 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:15.490 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr. 2021-01-27T13:27:15.508 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:15.548 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:15.655 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-27T13:27:15.673 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-27T13:27:15.713 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T13:27:16.033 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-27T13:27:16.034 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mon. 2021-01-27T13:27:16.049 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-27T13:27:16.052 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:16.084 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:16.090 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-27T13:27:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-logutils. 2021-01-27T13:27:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-27T13:27:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-27T13:27:16.780 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-27T13:27:16.799 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-27T13:27:16.838 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-27T13:27:17.099 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-mako. 2021-01-27T13:27:17.117 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-27T13:27:17.149 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T13:27:17.262 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-osd. 2021-01-27T13:27:17.284 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:17.338 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:17.460 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-27T13:27:17.480 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-27T13:27:17.519 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-27T13:27:17.821 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-27T13:27:17.842 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-27T13:27:17.888 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T13:27:18.174 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webob. 2021-01-27T13:27:18.194 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-27T13:27:18.232 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-27T13:27:18.552 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-27T13:27:18.569 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-27T13:27:18.610 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T13:27:18.904 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-bs4. 2021-01-27T13:27:18.921 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-27T13:27:18.954 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-27T13:27:19.241 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-waitress. 2021-01-27T13:27:19.259 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-27T13:27:19.294 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-27T13:27:19.552 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-tempita. 2021-01-27T13:27:19.570 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-27T13:27:19.601 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-27T13:27:19.879 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-paste. 2021-01-27T13:27:19.896 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-27T13:27:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T13:27:19.976 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph. 2021-01-27T13:27:19.992 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../43-ceph_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:20.034 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:20.283 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-27T13:27:20.300 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-27T13:27:20.341 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T13:27:20.362 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-fuse. 2021-01-27T13:27:20.380 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:20.420 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:20.685 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-27T13:27:20.702 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-27T13:27:20.743 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-27T13:27:20.840 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mds. 2021-01-27T13:27:20.857 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:20.898 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:21.071 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webtest. 2021-01-27T13:27:21.089 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-27T13:27:21.132 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-27T13:27:21.367 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephadm. 2021-01-27T13:27:21.384 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../46-cephadm_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:21.434 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:21.458 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pecan. 2021-01-27T13:27:21.476 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-27T13:27:21.516 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T13:27:21.754 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jinja2. 2021-01-27T13:27:21.770 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-27T13:27:21.811 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-27T13:27:21.853 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-27T13:27:21.870 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-27T13:27:21.911 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T13:27:22.114 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-27T13:27:22.131 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:22.173 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:22.259 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr. 2021-01-27T13:27:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:22.317 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:23.028 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-27T13:27:23.045 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-27T13:27:23.086 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-27T13:27:23.345 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mon. 2021-01-27T13:27:23.355 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjs-underscore. 2021-01-27T13:27:23.362 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:23.372 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-27T13:27:23.411 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:23.413 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T13:27:23.692 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-27T13:27:23.708 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-27T13:27:23.749 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T13:27:24.069 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-routes. 2021-01-27T13:27:24.087 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-27T13:27:24.127 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-27T13:27:24.480 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-27T13:27:24.498 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:24.499 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-osd. 2021-01-27T13:27:24.516 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:24.538 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:24.556 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:25.429 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-decorator. 2021-01-27T13:27:25.449 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-27T13:27:25.487 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T13:27:25.790 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-27T13:27:25.806 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-27T13:27:25.848 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T13:27:26.176 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-scipy. 2021-01-27T13:27:26.193 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-27T13:27:26.234 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-27T13:27:27.187 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph. 2021-01-27T13:27:27.204 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../43-ceph_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:27.244 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:27.552 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-27T13:27:27.572 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-27T13:27:27.610 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T13:27:27.614 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-fuse. 2021-01-27T13:27:27.632 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:27.672 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:28.093 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mds. 2021-01-27T13:27:28.114 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:28.150 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:28.670 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephadm. 2021-01-27T13:27:28.672 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-joblib. 2021-01-27T13:27:28.689 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-27T13:27:28.690 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../46-cephadm_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:28.728 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:28.730 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-27T13:27:29.081 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jinja2. 2021-01-27T13:27:29.094 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn. 2021-01-27T13:27:29.102 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-27T13:27:29.109 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-27T13:27:29.147 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-27T13:27:29.150 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T13:27:29.509 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-27T13:27:29.527 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:29.575 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:29.850 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-27T13:27:29.871 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:29.908 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:29.937 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-27T13:27:29.958 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-27T13:27:29.995 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-27T13:27:30.231 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjs-underscore. 2021-01-27T13:27:30.251 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-27T13:27:30.289 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T13:27:30.567 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-27T13:27:30.585 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-27T13:27:30.625 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T13:27:30.944 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-routes. 2021-01-27T13:27:30.961 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-27T13:27:31.002 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-27T13:27:31.011 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cachetools. 2021-01-27T13:27:31.029 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-27T13:27:31.069 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-27T13:27:31.305 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-27T13:27:31.329 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-27T13:27:31.363 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T13:27:31.372 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-27T13:27:31.389 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:31.700 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-27T13:27:31.720 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-27T13:27:31.758 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T13:27:32.061 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rsa. 2021-01-27T13:27:32.081 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-27T13:27:32.119 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-27T13:27:32.297 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-decorator. 2021-01-27T13:27:32.317 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-27T13:27:32.354 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T13:27:32.414 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-google-auth. 2021-01-27T13:27:32.435 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-27T13:27:32.472 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-27T13:27:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-27T13:27:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-27T13:27:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T13:27:32.792 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-27T13:27:32.810 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-27T13:27:32.850 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T13:27:32.993 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-scipy. 2021-01-27T13:27:33.012 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-27T13:27:33.043 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-27T13:27:33.170 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-websocket. 2021-01-27T13:27:33.191 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-27T13:27:33.228 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T13:27:33.539 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-27T13:27:33.557 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-27T13:27:33.622 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T13:27:34.144 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-27T13:27:34.162 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:34.202 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:34.555 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-27T13:27:34.573 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-27T13:27:34.586 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-27T13:27:34.604 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-27T13:27:34.612 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T13:27:34.644 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T13:27:34.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-27T13:27:34.958 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-27T13:27:34.999 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-27T13:27:35.181 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-joblib. 2021-01-27T13:27:35.202 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-27T13:27:35.273 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-27T13:27:35.302 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-27T13:27:35.323 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:35.360 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:35.652 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-sklearn. 2021-01-27T13:27:35.669 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-27T13:27:35.672 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-27T13:27:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-27T13:27:35.709 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T13:27:35.729 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-27T13:27:36.108 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-27T13:27:36.127 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T13:27:36.165 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T13:27:36.393 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-27T13:27:36.414 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:36.443 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package jq. 2021-01-27T13:27:36.451 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:36.463 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T13:27:36.501 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T13:27:36.754 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package socat. 2021-01-27T13:27:36.771 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-27T13:27:36.812 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-27T13:27:37.132 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package xmlstarlet. 2021-01-27T13:27:37.152 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-27T13:27:37.190 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-27T13:27:37.528 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-test. 2021-01-27T13:27:37.546 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../78-ceph-test_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:37.585 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:37.612 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cachetools. 2021-01-27T13:27:37.630 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-27T13:27:37.678 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-27T13:27:38.031 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-27T13:27:38.049 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-27T13:27:38.089 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T13:27:38.452 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-27T13:27:38.469 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-27T13:27:38.509 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T13:27:38.821 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rsa. 2021-01-27T13:27:38.842 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-27T13:27:38.879 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-27T13:27:39.174 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-google-auth. 2021-01-27T13:27:39.194 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-27T13:27:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-27T13:27:39.577 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-27T13:27:39.598 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-27T13:27:39.635 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T13:27:39.988 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-websocket. 2021-01-27T13:27:40.007 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-27T13:27:40.045 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T13:27:40.357 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-27T13:27:40.378 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-27T13:27:40.415 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T13:27:40.979 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-27T13:27:40.999 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:41.036 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:41.356 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-27T13:27:41.373 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-27T13:27:41.414 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T13:27:41.747 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-27T13:27:41.751 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-27T13:27:41.764 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:41.771 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-27T13:27:41.796 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-27T13:27:42.112 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-27T13:27:42.129 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-27T13:27:42.170 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:42.175 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package nvme-cli. 2021-01-27T13:27:42.193 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-27T13:27:42.250 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T13:27:42.514 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-27T13:27:42.533 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-27T13:27:42.572 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-27T13:27:42.781 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-27T13:27:42.798 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-27T13:27:42.839 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T13:27:42.942 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-27T13:27:42.960 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T13:27:43.001 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T13:27:43.142 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-attr. 2021-01-27T13:27:43.160 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-27T13:27:43.200 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-27T13:27:43.295 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package jq. 2021-01-27T13:27:43.313 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T13:27:43.353 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T13:27:43.536 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webencodings. 2021-01-27T13:27:43.554 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-27T13:27:43.594 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T13:27:43.631 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package socat. 2021-01-27T13:27:43.649 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-27T13:27:43.689 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-27T13:27:43.897 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-html5lib. 2021-01-27T13:27:43.914 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-27T13:27:43.955 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-27T13:27:44.009 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package xmlstarlet. 2021-01-27T13:27:44.026 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-27T13:27:44.067 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-27T13:27:44.342 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-27T13:27:44.358 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-27T13:27:44.399 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T13:27:44.413 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-test. 2021-01-27T13:27:44.434 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../78-ceph-test_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:44.470 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:44.896 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-packaging. 2021-01-27T13:27:44.915 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-27T13:27:44.953 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-27T13:27:45.272 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastescript. 2021-01-27T13:27:45.290 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-27T13:27:45.330 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-27T13:27:45.643 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pluggy. 2021-01-27T13:27:45.663 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-27T13:27:45.700 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-27T13:27:46.038 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-psutil. 2021-01-27T13:27:46.054 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-27T13:27:46.095 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T13:27:46.449 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-py. 2021-01-27T13:27:46.465 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-27T13:27:46.506 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-27T13:27:46.826 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-27T13:27:46.847 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-27T13:27:46.884 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T13:27:47.204 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-27T13:27:47.221 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-27T13:27:47.262 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T13:27:47.566 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pytest. 2021-01-27T13:27:47.582 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-27T13:27:47.622 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-27T13:27:48.060 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package radosgw. 2021-01-27T13:27:48.077 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../94-radosgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:48.118 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:48.633 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-27T13:27:48.653 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:48.690 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:49.094 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package nvme-cli. 2021-01-27T13:27:49.112 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-27T13:27:49.195 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T13:27:49.197 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package rbd-fuse. 2021-01-27T13:27:49.216 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:49.246 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:49.561 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-27T13:27:49.642 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-27T13:27:49.660 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-27T13:27:49.692 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T13:27:49.884 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T13:27:49.961 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-attr. 2021-01-27T13:27:49.982 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-27T13:27:50.018 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T13:27:50.019 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-27T13:27:50.144 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T13:27:50.330 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webencodings. 2021-01-27T13:27:50.337 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:50.348 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-27T13:27:50.388 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T13:27:50.716 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-html5lib. 2021-01-27T13:27:50.734 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-27T13:27:50.774 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-27T13:27:50.974 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user cephadm....done 2021-01-27T13:27:51.094 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-27T13:27:51.112 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-27T13:27:51.153 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T13:27:51.153 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-27T13:27:51.571 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-27T13:27:51.614 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-packaging. 2021-01-27T13:27:51.632 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-27T13:27:51.672 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-27T13:27:51.863 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-27T13:27:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-27T13:27:52.000 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pastescript. 2021-01-27T13:27:52.018 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-27T13:27:52.058 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-27T13:27:52.332 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-27T13:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pluggy. 2021-01-27T13:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-27T13:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-27T13:27:52.767 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-27T13:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-psutil. 2021-01-27T13:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-27T13:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T13:27:53.043 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-27T13:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-py. 2021-01-27T13:27:53.193 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-27T13:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-27T13:27:53.344 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T13:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-27T13:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-27T13:27:53.620 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T13:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T13:27:53.922 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:53.990 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-27T13:27:54.008 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-27T13:27:54.056 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T13:27:54.223 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T13:27:54.348 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-27T13:27:54.376 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pytest. 2021-01-27T13:27:54.394 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-27T13:27:54.434 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-27T13:27:54.658 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T13:27:54.905 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package radosgw. 2021-01-27T13:27:54.923 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../94-radosgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:54.959 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T13:27:54.962 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:55.336 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T13:27:55.628 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T13:27:55.921 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:56.047 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-27T13:27:56.074 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package rbd-fuse. 2021-01-27T13:27:56.095 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-27T13:27:56.132 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:56.390 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-27T13:27:56.441 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-27T13:27:56.691 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-27T13:27:56.754 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T13:27:56.871 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T13:27:56.997 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T13:27:57.025 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T13:27:57.160 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T13:27:57.215 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:57.461 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T13:27:57.871 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T13:27:57.877 INFO:teuthology.orchestra.run.smithi037.stdout:Adding system user cephadm....done 2021-01-27T13:27:58.038 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-27T13:27:58.264 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-27T13:27:58.390 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:27:58.433 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-27T13:27:58.707 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-27T13:27:58.708 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-27T13:27:58.866 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-27T13:27:59.059 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T13:27:59.169 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-27T13:27:59.210 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-27T13:27:59.611 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-27T13:27:59.628 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-27T13:27:59.904 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T13:27:59.912 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-27T13:28:00.205 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T13:28:00.255 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T13:28:00.540 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T13:28:00.548 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T13:28:00.841 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:00.866 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T13:28:01.142 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-27T13:28:01.159 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T13:28:01.285 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-27T13:28:01.435 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:01.561 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T13:28:01.594 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T13:28:01.687 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-27T13:28:01.879 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T13:28:01.955 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-27T13:28:02.247 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T13:28:02.272 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T13:28:02.573 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T13:28:02.573 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T13:28:02.890 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:02.923 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-27T13:28:03.033 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-27T13:28:03.184 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-27T13:28:03.310 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T13:28:03.376 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-27T13:28:03.620 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T13:28:03.694 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-27T13:28:03.930 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-27T13:28:04.095 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T13:28:04.221 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T13:28:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T13:28:04.407 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T13:28:04.530 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T13:28:04.572 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-27T13:28:04.932 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T13:28:05.034 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librados2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:05.160 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-27T13:28:05.309 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-27T13:28:05.435 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:05.761 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-27T13:28:06.121 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T13:28:06.247 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-27T13:28:06.373 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-27T13:28:06.624 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:06.665 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T13:28:06.725 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T13:28:06.835 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-27T13:28:06.966 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T13:28:07.253 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-27T13:28:07.287 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T13:28:07.335 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-27T13:28:07.555 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-27T13:28:07.605 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T13:28:07.847 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-27T13:28:07.906 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-27T13:28:08.224 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:08.358 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T13:28:08.492 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T13:28:08.509 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-27T13:28:08.802 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-27T13:28:08.835 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T13:28:09.545 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T13:28:09.848 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librbd1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:09.871 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T13:28:09.975 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T13:28:10.114 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T13:28:10.196 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-27T13:28:10.229 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-27T13:28:10.473 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-27T13:28:10.522 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-27T13:28:10.616 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T13:28:10.831 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:10.917 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T13:28:11.058 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T13:28:11.058 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T13:28:11.261 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-27T13:28:11.541 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:11.620 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T13:28:11.667 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-27T13:28:11.746 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T13:28:11.872 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-27T13:28:11.986 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T13:28:12.223 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librados2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:12.338 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:12.349 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-27T13:28:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:12.565 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:12.683 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-27T13:28:12.984 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-27T13:28:13.294 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:13.420 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:13.563 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T13:28:13.880 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:14.031 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T13:28:14.157 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-27T13:28:14.466 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:14.559 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-27T13:28:14.632 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-27T13:28:14.868 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-27T13:28:15.088 INFO:teuthology.orchestra.run.smithi099.stdout:Adding group ceph....done 2021-01-27T13:28:15.162 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-27T13:28:15.448 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user ceph....done 2021-01-27T13:28:15.546 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:15.633 INFO:teuthology.orchestra.run.smithi099.stdout:Setting system user ceph properties....done 2021-01-27T13:28:15.672 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:15.798 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T13:28:15.801 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-27T13:28:16.134 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-27T13:28:16.141 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T13:28:16.653 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:16.788 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:17.064 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T13:28:17.064 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T13:28:17.213 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librbd1 (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:17.339 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T13:28:17.465 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T13:28:17.591 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-27T13:28:17.798 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:17.892 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-27T13:28:18.166 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-27T13:28:18.193 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:18.418 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T13:28:18.418 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T13:28:18.641 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:18.861 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T13:28:18.861 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T13:28:18.895 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:19.021 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-27T13:28:19.327 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:19.355 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T13:28:19.548 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T13:28:19.548 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T13:28:19.724 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:19.867 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:19.985 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:19.995 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:20.085 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-27T13:28:20.207 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:20.379 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-27T13:28:20.697 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:20.822 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:20.860 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T13:28:20.861 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T13:28:20.974 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T13:28:21.332 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:21.458 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:21.610 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:21.831 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T13:28:21.832 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T13:28:21.918 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:22.302 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:22.437 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:22.548 INFO:teuthology.orchestra.run.smithi037.stdout:Adding group ceph....done 2021-01-27T13:28:22.562 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:22.706 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-27T13:28:22.892 INFO:teuthology.orchestra.run.smithi037.stdout:Adding system user ceph....done 2021-01-27T13:28:23.036 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T13:28:23.043 INFO:teuthology.orchestra.run.smithi037.stdout:Setting system user ceph properties....done 2021-01-27T13:28:23.220 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-27T13:28:23.577 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-27T13:28:24.080 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:24.206 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:24.477 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T13:28:24.478 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T13:28:25.167 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:25.521 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-27T13:28:25.977 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:26.188 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T13:28:26.189 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T13:28:26.302 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T13:28:26.620 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:26.712 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T13:28:26.715 DEBUG:teuthology.parallel:result is None 2021-01-27T13:28:26.837 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T13:28:26.838 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T13:28:27.288 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:27.431 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:27.982 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T13:28:27.982 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T13:28:28.442 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:28.559 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:28.677 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:28.885 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T13:28:28.886 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T13:28:29.387 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:29.529 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:29.655 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-27T13:28:29.799 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-27T13:28:30.133 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T13:28:33.319 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T13:28:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T13:28:33.719 DEBUG:teuthology.parallel:result is None 2021-01-27T13:28:33.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2021-01-27T13:28:33.767 INFO:teuthology.orchestra.run.smithi037.stdout:Ubuntu 2021-01-27T13:28:33.771 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T13:28:33.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:28:33.945 DEBUG:teuthology.orchestra.run.smithi037:> dpkg-query -W -f '${Version}' ceph 2021-01-27T13:28:33.971 INFO:teuthology.orchestra.run.smithi037.stdout:17.0.0-184-g507028cb-1focal 2021-01-27T13:28:33.971 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-184-g507028cb-1focal 2021-01-27T13:28:33.972 INFO:teuthology.task.install:The correct ceph version 17.0.0-184-g507028cb-1focal is installed. 2021-01-27T13:28:33.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo lsb_release -is 2021-01-27T13:28:34.024 INFO:teuthology.orchestra.run.smithi099.stdout:Ubuntu 2021-01-27T13:28:34.029 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T13:28:34.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:28:34.202 DEBUG:teuthology.orchestra.run.smithi099:> dpkg-query -W -f '${Version}' ceph 2021-01-27T13:28:34.226 INFO:teuthology.orchestra.run.smithi099.stdout:17.0.0-184-g507028cb-1focal 2021-01-27T13:28:34.227 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-184-g507028cb-1focal 2021-01-27T13:28:34.227 INFO:teuthology.task.install:The correct ceph version 17.0.0-184-g507028cb-1focal is installed. 2021-01-27T13:28:34.228 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-01-27T13:28:34.229 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:28:34.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-27T13:28:34.246 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:28:34.247 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-27T13:28:34.283 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-01-27T13:28:34.283 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:28:34.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2021-01-27T13:28:34.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-27T13:28:34.359 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:28:34.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2021-01-27T13:28:34.373 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-27T13:28:34.386 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-01-27T13:28:34.387 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:28:34.387 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-27T13:28:34.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-27T13:28:34.461 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:28:34.461 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-27T13:28:34.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-27T13:28:34.489 INFO:teuthology.run_tasks:Running task cephadm... 2021-01-27T13:28:34.627 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '507028cb839c25d6666833702df6325fd8569096', 'cephadm_mode': 'root'} 2021-01-27T13:28:34.628 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:28:34.631 INFO:tasks.cephadm:Cluster fsid is 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:28:34.632 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-01-27T13:28:34.632 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.c': '[v2:172.21.15.37:3301,v1:172.21.15.37:6790]', 'mon.b': '172.21.15.99'} 2021-01-27T13:28:34.632 INFO:tasks.cephadm:First mon is mon.a on smithi037 2021-01-27T13:28:34.633 INFO:tasks.cephadm:First mgr is y 2021-01-27T13:28:34.633 INFO:tasks.cephadm:Normalizing hostnames... 2021-01-27T13:28:34.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2021-01-27T13:28:34.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2021-01-27T13:28:34.669 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 507028cb839c25d6666833702df6325fd8569096)... 2021-01-27T13:28:34.669 DEBUG:teuthology.orchestra.run.smithi037:> git archive --remote=git://git.ceph.com/ceph-ci.git 507028cb839c25d6666833702df6325fd8569096 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2021-01-27T13:28:34.782 DEBUG:teuthology.orchestra.run.smithi099:> git archive --remote=git://git.ceph.com/ceph-ci.git 507028cb839c25d6666833702df6325fd8569096 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2021-01-27T13:28:34.901 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-01-27T13:28:34.909 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-01-27T13:28:34.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2021-01-27T13:28:34.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2021-01-27T13:28:34.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2021-01-27T13:28:35.011 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2021-01-27T13:28:35.029 INFO:tasks.cephadm:Adding local image mirror docker-mirror.front.sepia.ceph.com:5000 2021-01-27T13:28:35.030 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:28:35.030 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-27T13:28:35.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T13:28:35.061 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi037.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-27T13:28:35.062 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:28:35.062 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-27T13:28:35.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T13:28:35.077 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi099.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-27T13:28:35.078 INFO:tasks.cephadm:Writing seed config... 2021-01-27T13:28:35.080 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-01-27T13:28:35.080 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-01-27T13:28:35.081 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2021-01-27T13:28:35.081 INFO:tasks.cephadm: override: [global] ms type = async 2021-01-27T13:28:35.082 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-01-27T13:28:35.082 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-01-27T13:28:35.083 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-01-27T13:28:35.083 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-01-27T13:28:35.084 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-01-27T13:28:35.084 INFO:tasks.cephadm: override: [osd] debug ms = 20 2021-01-27T13:28:35.084 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-01-27T13:28:35.085 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-01-27T13:28:35.085 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:28:35.086 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-01-27T13:28:35.093 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8e2eaa02-60a3-11eb-8f9a-001a4aab830c mon election default strategy = 1 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-01-27T13:28:35.095 DEBUG:teuthology.orchestra.run.smithi037:mon.a> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a.service 2021-01-27T13:28:35.099 DEBUG:teuthology.orchestra.run.smithi037:mgr.y> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.y.service 2021-01-27T13:28:35.137 INFO:journalctl@ceph.mon.a.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:28:35.139 INFO:tasks.cephadm:Bootstrapping... 2021-01-27T13:28:35.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -v bootstrap --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-01-27T13:28:35.178 INFO:journalctl@ceph.mgr.y.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:28:35.449 INFO:teuthology.orchestra.run.smithi037.stderr:Could not locate podman: podman not found 2021-01-27T13:28:35.450 INFO:teuthology.orchestra.run.smithi037.stderr:Verifying podman|docker is present... 2021-01-27T13:28:35.450 INFO:teuthology.orchestra.run.smithi037.stderr:Verifying lvm2 is present... 2021-01-27T13:28:35.451 INFO:teuthology.orchestra.run.smithi037.stderr:Verifying time synchronization is in place... 2021-01-27T13:28:35.451 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled chrony.service 2021-01-27T13:28:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-01-27T13:28:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active chrony.service 2021-01-27T13:28:35.465 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: inactive 2021-01-27T13:28:35.466 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-27T13:28:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-01-27T13:28:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active chronyd.service 2021-01-27T13:28:35.480 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: inactive 2021-01-27T13:28:35.480 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-27T13:28:35.487 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: masked 2021-01-27T13:28:35.489 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-27T13:28:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: inactive 2021-01-27T13:28:35.495 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-27T13:28:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-01-27T13:28:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active ntpd.service 2021-01-27T13:28:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: inactive 2021-01-27T13:28:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled ntp.service 2021-01-27T13:28:35.518 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: enabled 2021-01-27T13:28:35.518 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active ntp.service 2021-01-27T13:28:35.524 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: active 2021-01-27T13:28:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:Unit ntp.service is enabled and running 2021-01-27T13:28:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:Repeating the final host check... 2021-01-27T13:28:35.526 INFO:teuthology.orchestra.run.smithi037.stderr:podman|docker (/usr/bin/docker) is present 2021-01-27T13:28:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl is present 2021-01-27T13:28:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:lvcreate is present 2021-01-27T13:28:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled chrony.service 2021-01-27T13:28:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-01-27T13:28:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active chrony.service 2021-01-27T13:28:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: inactive 2021-01-27T13:28:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-27T13:28:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-01-27T13:28:35.547 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active chronyd.service 2021-01-27T13:28:35.554 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: inactive 2021-01-27T13:28:35.555 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-27T13:28:35.562 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: masked 2021-01-27T13:28:35.563 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-27T13:28:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: inactive 2021-01-27T13:28:35.571 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-27T13:28:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-01-27T13:28:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active ntpd.service 2021-01-27T13:28:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: inactive 2021-01-27T13:28:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-enabled ntp.service 2021-01-27T13:28:35.594 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: enabled 2021-01-27T13:28:35.594 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl is-active ntp.service 2021-01-27T13:28:35.601 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: active 2021-01-27T13:28:35.602 INFO:teuthology.orchestra.run.smithi037.stderr:Unit ntp.service is enabled and running 2021-01-27T13:28:35.602 INFO:teuthology.orchestra.run.smithi037.stderr:Host looks OK 2021-01-27T13:28:35.602 INFO:teuthology.orchestra.run.smithi037.stderr:Cluster fsid: 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:28:35.603 INFO:teuthology.orchestra.run.smithi037.stderr:Acquiring lock 139797021006912 on /run/cephadm/8e2eaa02-60a3-11eb-8f9a-001a4aab830c.lock 2021-01-27T13:28:35.603 INFO:teuthology.orchestra.run.smithi037.stderr:Lock 139797021006912 acquired on /run/cephadm/8e2eaa02-60a3-11eb-8f9a-001a4aab830c.lock 2021-01-27T13:28:35.604 INFO:teuthology.orchestra.run.smithi037.stderr:Verifying IP 172.21.15.37 port 3300 ... 2021-01-27T13:28:35.604 INFO:teuthology.orchestra.run.smithi037.stderr:Verifying IP 172.21.15.37 port 6789 ... 2021-01-27T13:28:35.604 INFO:teuthology.orchestra.run.smithi037.stderr:Base mon IP is 172.21.15.37, final addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2021-01-27T13:28:35.605 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/sbin/ip route ls 2021-01-27T13:28:35.607 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: default via 172.21.15.254 dev ens1f0 2021-01-27T13:28:35.607 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-01-27T13:28:35.608 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 2021-01-27T13:28:35.609 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/sbin/ip -6 route ls 2021-01-27T13:28:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-01-27T13:28:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2021-01-27T13:28:35.613 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2021-01-27T13:28:35.613 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/sbin/ip -6 addr ls 2021-01-27T13:28:35.615 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-01-27T13:28:35.616 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: inet6 ::1/128 scope host 2021-01-27T13:28:35.616 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-01-27T13:28:35.617 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2021-01-27T13:28:35.617 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2021-01-27T13:28:35.618 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-01-27T13:28:35.619 INFO:teuthology.orchestra.run.smithi037.stderr:Mon IP 172.21.15.37 is in CIDR network 172.21.0.0/20 2021-01-27T13:28:35.620 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096... 2021-01-27T13:28:35.620 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:28:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: 507028cb839c25d6666833702df6325fd8569096: Pulling from ceph-ci/ceph 2021-01-27T13:28:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: 889524391d55: Pulling fs layer 2021-01-27T13:28:36.541 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: 4c303d906d85: Pulling fs layer 2021-01-27T13:28:37.274 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: 889524391d55: Download complete 2021-01-27T13:28:39.255 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: 4c303d906d85: Verifying Checksum 2021-01-27T13:28:39.256 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: 4c303d906d85: Download complete 2021-01-27T13:28:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: 889524391d55: Pull complete 2021-01-27T13:28:50.114 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: 4c303d906d85: Pull complete 2021-01-27T13:28:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: Digest: sha256:c489442ef6855dff2d8ef5c2bf059a3e3799787d2dd370f561e71fe7fd43e3ef 2021-01-27T13:28:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: Status: Downloaded newer image for quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:28:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/docker: quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:28:50.262 INFO:teuthology.orchestra.run.smithi037.stderr:Extracting ceph user uid/gid from container image... 2021-01-27T13:28:50.263 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint stat -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -c %u %g /var/lib/ceph 2021-01-27T13:29:01.230 INFO:teuthology.orchestra.run.smithi037.stderr:stat: 167 167 2021-01-27T13:29:01.994 INFO:teuthology.orchestra.run.smithi037.stderr:Creating initial keys... 2021-01-27T13:29:01.994 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-27T13:29:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-authtool: AQCfahFgvc+wAhAAbVd66puLI6GKDjWLPR/Cwg== 2021-01-27T13:29:03.581 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-27T13:29:04.647 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-authtool: AQCgahFgTMC5JhAAsKWbjayAZ2rJD2oESzaCvA== 2021-01-27T13:29:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-27T13:29:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-authtool: AQCiahFg69zIFhAAXHLVwtlwO0JGmFUTdHX4Dg== 2021-01-27T13:29:07.060 INFO:teuthology.orchestra.run.smithi037.stderr:Creating initial monmap... 2021-01-27T13:29:07.060 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/monmaptool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /tmp/ceph-tmpixlsz86e:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --create --clobber --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c --addv a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] /tmp/monmap 2021-01-27T13:29:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-27T13:29:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-27T13:29:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:monmaptool for a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-27T13:29:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/monmaptool: set fsid to 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-27T13:29:08.866 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:29:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:Creating mon... 2021-01-27T13:29:08.867 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-mon -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp9p8tcl1f:/tmp/keyring:z -v /tmp/ceph-tmpixlsz86e:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --mkfs -i a --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-01-27T13:29:09.950 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T13:29:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 1 imported monmap: 2021-01-27T13:29:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: epoch 0 2021-01-27T13:29:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: last_changed 2021-01-27T13:29:08.158447+0000 2021-01-27T13:29:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: created 2021-01-27T13:29:08.158447+0000 2021-01-27T13:29:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2021-01-27T13:29:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: election_strategy: 1 2021-01-27T13:29:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2021-01-27T13:29:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 0 /usr/bin/ceph-mon: set fsid to 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T13:29:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T13:29:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T13:29:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: DB SUMMARY 2021-01-27T13:29:10.002 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.002 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-01-27T13:29:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-01-27T13:29:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T13:29:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.create_if_missing: 1 2021-01-27T13:29:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T13:29:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.env: 0x564a5e2ed1c0 2021-01-27T13:29:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.fs: Posix File System 2021-01-27T13:29:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.info_log: 0x564a5fdf0920 2021-01-27T13:29:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T13:29:10.005 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.statistics: (nil) 2021-01-27T13:29:10.005 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.use_fsync: 0 2021-01-27T13:29:10.005 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T13:29:10.005 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T13:29:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T13:29:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T13:29:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T13:29:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T13:29:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T13:29:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T13:29:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T13:29:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T13:29:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T13:29:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.db_log_dir: 2021-01-27T13:29:10.008 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-27T13:29:10.008 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T13:29:10.008 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T13:29:10.009 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T13:29:10.009 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T13:29:10.009 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T13:29:10.009 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T13:29:10.009 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T13:29:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T13:29:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T13:29:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T13:29:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.write_buffer_manager: 0x564a5fdb71d0 2021-01-27T13:29:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T13:29:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T13:29:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T13:29:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T13:29:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T13:29:10.012 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T13:29:10.012 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T13:29:10.012 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T13:29:10.012 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T13:29:10.012 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.unordered_write: 0 2021-01-27T13:29:10.012 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T13:29:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T13:29:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T13:29:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T13:29:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.row_cache: None 2021-01-27T13:29:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.wal_filter: None 2021-01-27T13:29:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T13:29:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T13:29:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T13:29:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T13:29:10.015 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T13:29:10.015 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T13:29:10.015 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T13:29:10.015 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T13:29:10.016 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T13:29:10.016 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T13:29:10.016 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T13:29:10.016 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T13:29:10.017 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T13:29:10.017 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T13:29:10.017 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T13:29:10.017 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T13:29:10.017 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T13:29:10.018 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T13:29:10.018 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T13:29:10.018 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T13:29:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T13:29:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.max_open_files: -1 2021-01-27T13:29:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T13:29:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T13:29:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T13:29:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T13:29:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Compression algorithms supported: 2021-01-27T13:29:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T13:29:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: kZSTD supported: 0 2021-01-27T13:29:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T13:29:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T13:29:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T13:29:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T13:29:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T13:29:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T13:29:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.948+0000 7f056661c700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T13:29:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2021-01-27T13:29:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-01-27T13:29:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.023 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T13:29:10.023 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.023 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T13:29:10.023 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.merge_operator: 2021-01-27T13:29:10.023 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_filter: None 2021-01-27T13:29:10.024 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T13:29:10.024 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T13:29:10.024 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T13:29:10.024 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564a5fd061c8) 2021-01-27T13:29:10.024 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2021-01-27T13:29:10.025 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T13:29:10.025 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T13:29:10.025 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2021-01-27T13:29:10.025 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: index_type: 0 2021-01-27T13:29:10.025 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2021-01-27T13:29:10.026 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: index_shortening: 1 2021-01-27T13:29:10.026 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2021-01-27T13:29:10.026 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2021-01-27T13:29:10.026 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: checksum: 1 2021-01-27T13:29:10.026 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2021-01-27T13:29:10.027 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: block_cache: 0x564a5fd3e110 2021-01-27T13:29:10.027 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2021-01-27T13:29:10.027 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: block_cache_options: 2021-01-27T13:29:10.027 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: capacity : 536870912 2021-01-27T13:29:10.027 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2021-01-27T13:29:10.028 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2021-01-27T13:29:10.028 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2021-01-27T13:29:10.028 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2021-01-27T13:29:10.028 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2021-01-27T13:29:10.028 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: block_size: 4096 2021-01-27T13:29:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2021-01-27T13:29:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2021-01-27T13:29:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2021-01-27T13:29:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2021-01-27T13:29:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: partition_filters: 0 2021-01-27T13:29:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2021-01-27T13:29:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T13:29:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2021-01-27T13:29:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: verify_compression: 0 2021-01-27T13:29:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2021-01-27T13:29:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: format_version: 2 2021-01-27T13:29:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2021-01-27T13:29:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: block_align: 0 2021-01-27T13:29:10.031 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.032 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T13:29:10.032 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T13:29:10.032 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compression: NoCompression 2021-01-27T13:29:10.032 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T13:29:10.032 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T13:29:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T13:29:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.num_levels: 7 2021-01-27T13:29:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T13:29:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T13:29:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T13:29:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T13:29:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T13:29:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T13:29:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T13:29:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T13:29:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T13:29:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T13:29:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T13:29:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T13:29:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T13:29:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T13:29:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T13:29:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T13:29:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T13:29:10.036 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T13:29:10.037 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T13:29:10.037 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T13:29:10.037 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T13:29:10.037 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T13:29:10.037 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T13:29:10.038 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T13:29:10.038 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T13:29:10.038 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T13:29:10.038 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T13:29:10.038 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T13:29:10.039 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T13:29:10.039 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T13:29:10.039 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T13:29:10.039 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T13:29:10.039 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T13:29:10.040 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T13:29:10.040 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T13:29:10.040 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T13:29:10.040 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T13:29:10.040 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T13:29:10.040 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T13:29:10.041 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T13:29:10.041 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T13:29:10.041 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T13:29:10.041 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T13:29:10.041 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T13:29:10.042 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T13:29:10.042 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T13:29:10.042 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T13:29:10.042 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T13:29:10.042 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T13:29:10.043 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T13:29:10.043 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T13:29:10.043 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T13:29:10.043 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T13:29:10.043 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T13:29:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T13:29:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T13:29:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T13:29:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T13:29:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T13:29:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.ttl: 2592000 2021-01-27T13:29:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.952+0000 7f056661c700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T13:29:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.956+0000 7f056661c700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T13:29:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.956+0000 7f056661c700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T13:29:10.046 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.046 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.956+0000 7f056661c700 4 rocksdb: DB pointer 0x564a5fdfd800 2021-01-27T13:29:10.046 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.956+0000 7f054f4be700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T13:29:10.046 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.956+0000 7f054f4be700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T13:29:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2021-01-27T13:29:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:29:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T13:29:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T13:29:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T13:29:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T13:29:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T13:29:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T13:29:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-27T13:29:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:29:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:29:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T13:29:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T13:29:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-27T13:29:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:29:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:29:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:29:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T13:29:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T13:29:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T13:29:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T13:29:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-01-27T13:29:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:29:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:29:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T13:29:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-01-27T13:29:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-27T13:29:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:29:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:29:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T13:29:10.054 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T13:29:10.054 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.054 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-27T13:29:10.054 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:29:10.054 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:29:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:29:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T13:29:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T13:29:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T13:29:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T13:29:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-01-27T13:29:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:29:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:29:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T13:29:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-01-27T13:29:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: 2021-01-27T13:29:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.960+0000 7f056661c700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2021-01-27T13:29:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.960+0000 7f056661c700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2021-01-27T13:29:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph-mon: "debug "2021-01-27T13:29:09.960+0000 7f056661c700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-01-27T13:29:10.673 INFO:teuthology.orchestra.run.smithi037.stderr:create mon.a on 2021-01-27T13:29:10.673 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:10.681 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl disable ceph.target 2021-01-27T13:29:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-01-27T13:29:11.226 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl enable ceph.target 2021-01-27T13:29:11.260 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-01-27T13:29:12.458 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl start ceph.target 2021-01-27T13:29:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl enable ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c.target 2021-01-27T13:29:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c.target -> /etc/systemd/system/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c.target. 2021-01-27T13:29:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c.target -> /etc/systemd/system/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c.target. 2021-01-27T13:29:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl start ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c.target 2021-01-27T13:29:13.713 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl daemon-reload 2021-01-27T13:29:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl stop ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T13:29:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl reset-failed ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T13:29:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Failed to reset failed state of unit ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a.service: Unit ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a.service not loaded. 2021-01-27T13:29:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl enable ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T13:29:14.982 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Created symlink /etc/systemd/system/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c.target.wants/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@.service. 2021-01-27T13:29:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl start ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T13:29:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:firewalld does not appear to be present 2021-01-27T13:29:16.168 INFO:teuthology.orchestra.run.smithi037.stderr:Not possible to enable service . firewalld.service is not available 2021-01-27T13:29:16.169 INFO:teuthology.orchestra.run.smithi037.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-27T13:29:16.171 INFO:teuthology.orchestra.run.smithi037.stderr:Waiting for mon to start... 2021-01-27T13:29:16.172 INFO:teuthology.orchestra.run.smithi037.stderr:Waiting for mon... 2021-01-27T13:29:16.173 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status 2021-01-27T13:29:19.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:19 smithi037 bash[9342]: cluster 2021-01-27T13:29:18.965079+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T13:29:20.183 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: cluster: 2021-01-27T13:29:20.183 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: id: 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-01-27T13:29:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: services: 2021-01-27T13:29:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 1.14659s) 2021-01-27T13:29:20.186 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: mgr: no daemons active 2021-01-27T13:29:20.186 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-01-27T13:29:20.187 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:20.187 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: data: 2021-01-27T13:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-01-27T13:29:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-01-27T13:29:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-01-27T13:29:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: pgs: 2021-01-27T13:29:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:20.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:20 smithi037 bash[9342]: cluster 2021-01-27T13:29:19.034545+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T13:29:20.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:20 smithi037 bash[9342]: cluster 2021-01-27T13:29:19.041884+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} 2021-01-27T13:29:20.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:20 smithi037 bash[9342]: cluster 2021-01-27T13:29:19.051183+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-01-27T13:29:20.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:20 smithi037 bash[9342]: cluster 2021-01-27T13:29:19.061942+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-27T13:29:20.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:20 smithi037 bash[9342]: cluster 2021-01-27T13:29:19.073097+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-01-27T13:29:21.291 INFO:teuthology.orchestra.run.smithi037.stderr:mon is available 2021-01-27T13:29:21.292 INFO:teuthology.orchestra.run.smithi037.stderr:Assimilating anything we can from ceph.conf... 2021-01-27T13:29:21.292 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z -v /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-01-27T13:29:21.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:21 smithi037 bash[9342]: audit 2021-01-27T13:29:20.180270+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.37:0/1932253357' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-01-27T13:29:22.668 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:22.668 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: [global] 2021-01-27T13:29:22.669 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: fsid = 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:22.669 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2021-01-27T13:29:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-01-27T13:29:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-01-27T13:29:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-01-27T13:29:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-01-27T13:29:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: [mgr] 2021-01-27T13:29:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-01-27T13:29:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: [osd] 2021-01-27T13:29:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-01-27T13:29:22.673 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-01-27T13:29:23.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:22 smithi037 bash[9342]: audit 2021-01-27T13:29:22.665637+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.37:0/1792326578' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-01-27T13:29:23.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:22 smithi037 bash[9342]: audit 2021-01-27T13:29:22.670089+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.37:0/1792326578' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-01-27T13:29:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:Generating new minimal ceph.conf... 2021-01-27T13:29:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z -v /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-01-27T13:29:25.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:24 smithi037 bash[9342]: audit 2021-01-27T13:29:24.700485+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.37:0/2865754543' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:29:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:Restarting the monitor... 2021-01-27T13:29:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl restart ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T13:29:25.733 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:25 smithi037 systemd[1]: Stopping Ceph mon.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c... 2021-01-27T13:29:25.733 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:25 smithi037 bash[9342]: debug 2021-01-27T13:29:25.532+0000 7f1f18a1f700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-01-27T13:29:25.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:25 smithi037 bash[9342]: debug 2021-01-27T13:29:25.532+0000 7f1f18a1f700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-01-27T13:29:26.354 INFO:teuthology.orchestra.run.smithi037.stderr:Setting mon public_network... 2021-01-27T13:29:26.355 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config set mon public_network 172.21.0.0/20 2021-01-27T13:29:26.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:26 smithi037 docker[9663]: ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c-mon.a 2021-01-27T13:29:26.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:26 smithi037 systemd[1]: ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.a.service: Succeeded. 2021-01-27T13:29:26.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:26 smithi037 systemd[1]: Stopped Ceph mon.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:29:26.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:26 smithi037 systemd[1]: Started Ceph mon.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:29:28.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.988+0000 7ff321ad2700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T13:29:28.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.988+0000 7ff321ad2700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-27T13:29:28.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.988+0000 7ff321ad2700 0 pidfile_write: ignore empty --pid-file 2021-01-27T13:29:28.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 0 load: jerasure load: lrc load: isa 2021-01-27T13:29:28.309 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T13:29:28.309 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T13:29:28.310 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T13:29:28.310 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: DB SUMMARY 2021-01-27T13:29:28.311 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T13:29:28.311 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T13:29:28.311 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2021-01-27T13:29:28.312 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-01-27T13:29:28.312 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 74222 ; 2021-01-27T13:29:28.313 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T13:29:28.313 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T13:29:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T13:29:28.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.env: 0x55d2ec9821c0 2021-01-27T13:29:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.fs: Posix File System 2021-01-27T13:29:28.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.info_log: 0x55d2ee2a3e80 2021-01-27T13:29:28.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T13:29:28.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.statistics: (nil) 2021-01-27T13:29:28.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.use_fsync: 0 2021-01-27T13:29:28.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T13:29:28.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T13:29:28.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T13:29:28.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T13:29:28.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T13:29:28.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T13:29:28.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T13:29:28.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T13:29:28.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T13:29:28.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T13:29:28.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T13:29:28.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.db_log_dir: 2021-01-27T13:29:28.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-27T13:29:28.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T13:29:28.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T13:29:28.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T13:29:28.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T13:29:28.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T13:29:28.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T13:29:28.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T13:29:28.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T13:29:28.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T13:29:28.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T13:29:28.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.write_buffer_manager: 0x55d2ee2fdc50 2021-01-27T13:29:28.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T13:29:28.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T13:29:28.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T13:29:28.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T13:29:28.330 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T13:29:28.330 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T13:29:28.330 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T13:29:28.331 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T13:29:28.331 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T13:29:28.332 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.unordered_write: 0 2021-01-27T13:29:28.332 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T13:29:28.332 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T13:29:28.333 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T13:29:28.333 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T13:29:28.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.row_cache: None 2021-01-27T13:29:28.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.wal_filter: None 2021-01-27T13:29:28.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T13:29:28.335 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T13:29:28.335 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T13:29:28.336 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T13:29:28.336 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T13:29:28.336 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T13:29:28.337 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T13:29:28.337 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T13:29:28.338 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T13:29:28.338 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T13:29:28.339 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T13:29:28.339 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T13:29:28.340 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T13:29:28.340 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T13:29:28.340 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T13:29:28.341 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T13:29:28.341 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T13:29:28.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T13:29:28.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T13:29:28.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T13:29:28.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T13:29:28.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_open_files: -1 2021-01-27T13:29:28.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T13:29:28.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T13:29:28.345 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T13:29:28.345 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T13:29:28.345 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Compression algorithms supported: 2021-01-27T13:29:28.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T13:29:28.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: kZSTD supported: 0 2021-01-27T13:29:28.347 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T13:29:28.347 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T13:29:28.347 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T13:29:28.348 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T13:29:28.348 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T13:29:28.349 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T13:29:28.349 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T13:29:28.349 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-01-27T13:29:28.350 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T13:29:28.350 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T13:29:28.351 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.merge_operator: 2021-01-27T13:29:28.351 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_filter: None 2021-01-27T13:29:28.351 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T13:29:28.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T13:29:28.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T13:29:28.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d2ee24c1e0) 2021-01-27T13:29:28.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: cache_index_and_filter_blocks: 1 2021-01-27T13:29:28.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T13:29:28.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T13:29:28.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: pin_top_level_index_and_filter: 1 2021-01-27T13:29:28.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: index_type: 0 2021-01-27T13:29:28.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: data_block_index_type: 0 2021-01-27T13:29:28.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: index_shortening: 1 2021-01-27T13:29:28.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T13:29:28.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: hash_index_allow_collision: 1 2021-01-27T13:29:28.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: checksum: 1 2021-01-27T13:29:28.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: no_block_cache: 0 2021-01-27T13:29:28.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: block_cache: 0x55d2ee284510 2021-01-27T13:29:28.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: block_cache_name: BinnedLRUCache 2021-01-27T13:29:28.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: block_cache_options: 2021-01-27T13:29:28.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: capacity : 536870912 2021-01-27T13:29:28.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: num_shard_bits : 4 2021-01-27T13:29:28.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: strict_capacity_limit : 0 2021-01-27T13:29:28.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: high_pri_pool_ratio: 0.000 2021-01-27T13:29:28.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: block_cache_compressed: (nil) 2021-01-27T13:29:28.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: persistent_cache: (nil) 2021-01-27T13:29:28.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: block_size: 4096 2021-01-27T13:29:28.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:27 smithi037 bash[9724]: block_size_deviation: 10 2021-01-27T13:29:28.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: block_restart_interval: 16 2021-01-27T13:29:28.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: index_block_restart_interval: 1 2021-01-27T13:29:28.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: metadata_block_size: 4096 2021-01-27T13:29:28.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: partition_filters: 0 2021-01-27T13:29:28.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: use_delta_encoding: 1 2021-01-27T13:29:28.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T13:29:28.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: whole_key_filtering: 1 2021-01-27T13:29:28.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: verify_compression: 0 2021-01-27T13:29:28.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: read_amp_bytes_per_bit: 0 2021-01-27T13:29:28.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: format_version: 2 2021-01-27T13:29:28.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: enable_index_compression: 1 2021-01-27T13:29:28.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: block_align: 0 2021-01-27T13:29:28.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T13:29:28.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T13:29:28.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compression: NoCompression 2021-01-27T13:29:28.369 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T13:29:28.369 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T13:29:28.369 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T13:29:28.370 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.num_levels: 7 2021-01-27T13:29:28.370 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T13:29:28.370 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T13:29:28.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T13:29:28.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T13:29:28.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T13:29:28.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T13:29:28.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T13:29:28.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T13:29:28.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T13:29:28.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T13:29:28.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T13:29:28.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T13:29:28.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T13:29:28.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T13:29:28.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T13:29:28.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T13:29:28.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T13:29:28.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T13:29:28.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T13:29:28.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T13:29:28.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T13:29:28.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T13:29:28.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T13:29:28.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T13:29:28.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T13:29:28.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T13:29:28.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T13:29:28.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T13:29:28.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T13:29:28.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T13:29:28.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T13:29:28.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T13:29:28.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T13:29:28.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T13:29:28.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T13:29:28.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T13:29:28.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T13:29:28.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T13:29:28.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T13:29:28.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T13:29:28.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T13:29:28.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T13:29:28.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T13:29:28.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T13:29:28.380 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T13:29:28.380 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T13:29:28.380 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T13:29:28.380 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T13:29:28.380 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T13:29:28.380 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T13:29:28.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T13:29:28.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T13:29:28.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T13:29:28.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T13:29:28.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T13:29:28.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T13:29:28.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T13:29:28.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T13:29:28.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T13:29:28.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.ttl: 2592000 2021-01-27T13:29:28.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.992+0000 7ff321ad2700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T13:29:28.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.996+0000 7ff321ad2700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T13:29:28.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.996+0000 7ff321ad2700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2021-01-27T13:29:28.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.996+0000 7ff321ad2700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754167999077, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-01-27T13:29:28.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.996+0000 7ff321ad2700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2021-01-27T13:29:28.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.996+0000 7ff321ad2700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T13:29:28.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.996+0000 7ff321ad2700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754168000938, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 70735, "table_properties": {"data_size": 68996, "index_size": 344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 8965, "raw_average_key_size": 45, "raw_value_size": 63827, "raw_average_value_size": 327, "num_data_blocks": 11, "num_entries": 195, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611754167, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T13:29:28.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:27.996+0000 7ff321ad2700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2021-01-27T13:29:28.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.000+0000 7ff321ad2700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754168002741, "job": 1, "event": "recovery_finished"} 2021-01-27T13:29:28.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.000+0000 7ff321ad2700 4 rocksdb: DB pointer 0x55d2ee343800 2021-01-27T13:29:28.385 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.000+0000 7ff321ad2700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:28.385 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.000+0000 7ff3088f3700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T13:29:28.385 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.000+0000 7ff3088f3700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T13:29:28.385 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ** DB Stats ** 2021-01-27T13:29:28.385 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:29:28.386 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T13:29:28.386 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T13:29:28.386 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T13:29:28.386 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T13:29:28.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T13:29:28.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T13:29:28.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ** Compaction Stats [default] ** 2021-01-27T13:29:28.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:29:28.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:29:28.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: L0 2/0 70.73 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.0 0.00 0.00 1 0.001 0 0 2021-01-27T13:29:28.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Sum 2/0 70.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.0 0.00 0.00 1 0.001 0 0 2021-01-27T13:29:28.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.0 0.00 0.00 1 0.001 0 0 2021-01-27T13:29:28.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ** Compaction Stats [default] ** 2021-01-27T13:29:28.388 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:29:28.389 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:29:28.389 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 63.0 0.00 0.00 1 0.001 0 0 2021-01-27T13:29:28.389 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:29:28.389 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T13:29:28.389 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T13:29:28.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T13:29:28.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T13:29:28.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T13:29:28.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Cumulative compaction: 0.00 GB write, 7.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:29:28.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Interval compaction: 0.00 GB write, 7.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:29:28.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T13:29:28.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T13:29:28.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ** Compaction Stats [default] ** 2021-01-27T13:29:28.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:29:28.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:29:28.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: L0 2/0 70.73 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.0 0.00 0.00 1 0.001 0 0 2021-01-27T13:29:28.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Sum 2/0 70.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.0 0.00 0.00 1 0.001 0 0 2021-01-27T13:29:28.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T13:29:28.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ** Compaction Stats [default] ** 2021-01-27T13:29:28.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:29:28.393 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:29:28.393 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 63.0 0.00 0.00 1 0.001 0 0 2021-01-27T13:29:28.393 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:29:28.393 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T13:29:28.393 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T13:29:28.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T13:29:28.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T13:29:28.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T13:29:28.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Cumulative compaction: 0.00 GB write, 7.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:29:28.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:29:28.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T13:29:28.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T13:29:28.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.004+0000 7ff321ad2700 1 mon.a@-1(???) e1 preinit fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:28.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 0 mon.a@-1(???).mds e1 new map 2021-01-27T13:29:28.396 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 0 mon.a@-1(???).mds e1 print_map 2021-01-27T13:29:28.396 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: e1 2021-01-27T13:29:28.396 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T13:29:28.396 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T13:29:28.396 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: legacy client fscid: -1 2021-01-27T13:29:28.397 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: 2021-01-27T13:29:28.397 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: No filesystems configured 2021-01-27T13:29:28.397 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-01-27T13:29:28.397 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T13:29:28.397 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T13:29:28.398 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T13:29:28.398 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: audit 2021-01-27T13:29:24.700485+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.37:0/2865754543' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:29:28.398 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-01-27T13:29:28.398 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta expand map: {default=false} 2021-01-27T13:29:28.398 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta from 'false' to 'false' 2021-01-27T13:29:28.399 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta expanded map: {default=false} 2021-01-27T13:29:28.399 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta expand map: {default=info} 2021-01-27T13:29:28.399 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta from 'info' to 'info' 2021-01-27T13:29:28.399 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta expanded map: {default=info} 2021-01-27T13:29:28.399 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta expand map: {default=daemon} 2021-01-27T13:29:28.400 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-27T13:29:28.400 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-27T13:29:28.400 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta expand map: {default=debug} 2021-01-27T13:29:28.400 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-27T13:29:28.400 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: debug 2021-01-27T13:29:28.008+0000 7ff321ad2700 20 expand_channel_meta expanded map: {default=debug} 2021-01-27T13:29:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: cluster 2021-01-27T13:29:28.016280+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T13:29:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: cluster 2021-01-27T13:29:28.016373+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} 2021-01-27T13:29:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: cluster 2021-01-27T13:29:28.016432+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-01-27T13:29:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: cluster 2021-01-27T13:29:28.016477+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-27T13:29:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:28 smithi037 bash[9724]: cluster 2021-01-27T13:29:28.017052+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-01-27T13:29:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:Wrote config to /etc/ceph/ceph.conf 2021-01-27T13:29:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-01-27T13:29:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:Creating mgr... 2021-01-27T13:29:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:Verifying port 9283 ... 2021-01-27T13:29:29.005 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl daemon-reload 2021-01-27T13:29:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl stop ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T13:29:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl reset-failed ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T13:29:29.238 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Failed to reset failed state of unit ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.y.service: Unit ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.y.service not loaded. 2021-01-27T13:29:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl enable ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T13:29:29.246 INFO:teuthology.orchestra.run.smithi037.stderr:systemctl: Created symlink /etc/systemd/system/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c.target.wants/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@.service. 2021-01-27T13:29:29.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:29 smithi037 bash[9724]: audit 2021-01-27T13:29:28.255225+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.37:0/2342743382' entity='client.admin' 2021-01-27T13:29:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: systemctl start ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T13:29:29.452 INFO:teuthology.orchestra.run.smithi037.stderr:firewalld does not appear to be present 2021-01-27T13:29:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:Not possible to enable service . firewalld.service is not available 2021-01-27T13:29:29.453 INFO:teuthology.orchestra.run.smithi037.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-27T13:29:29.454 INFO:teuthology.orchestra.run.smithi037.stderr:firewalld does not appear to be present 2021-01-27T13:29:29.454 INFO:teuthology.orchestra.run.smithi037.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-01-27T13:29:29.454 INFO:teuthology.orchestra.run.smithi037.stderr:Waiting for mgr to start... 2021-01-27T13:29:29.454 INFO:teuthology.orchestra.run.smithi037.stderr:Waiting for mgr... 2021-01-27T13:29:29.455 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-27T13:29:31.345 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:31.346 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: { 2021-01-27T13:29:31.346 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "fsid": "8e2eaa02-60a3-11eb-8f9a-001a4aab830c", 2021-01-27T13:29:31.346 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "health": { 2021-01-27T13:29:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-27T13:29:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "checks": {}, 2021-01-27T13:29:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "mutes": [] 2021-01-27T13:29:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-27T13:29:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum": [ 2021-01-27T13:29:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 0 2021-01-27T13:29:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-27T13:29:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "a" 2021-01-27T13:29:31.349 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:31.349 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum_age": 3, 2021-01-27T13:29:31.349 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "monmap": { 2021-01-27T13:29:31.349 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:31.350 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-27T13:29:31.350 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-27T13:29:31.350 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:31.350 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osdmap": { 2021-01-27T13:29:31.350 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:31.351 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-27T13:29:31.351 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-27T13:29:31.351 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-27T13:29:31.351 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-27T13:29:31.351 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-27T13:29:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-27T13:29:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "pgmap": { 2021-01-27T13:29:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-27T13:29:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-27T13:29:31.353 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-27T13:29:31.353 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-27T13:29:31.354 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-27T13:29:31.354 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-27T13:29:31.355 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-27T13:29:31.355 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-27T13:29:31.355 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:31.355 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "fsmap": { 2021-01-27T13:29:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-27T13:29:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-27T13:29:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:31.357 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-27T13:29:31.357 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "available": false, 2021-01-27T13:29:31.357 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-27T13:29:31.357 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "modules": [ 2021-01-27T13:29:31.357 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "iostat", 2021-01-27T13:29:31.358 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "restful" 2021-01-27T13:29:31.358 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:31.358 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "services": {} 2021-01-27T13:29:31.358 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "servicemap": { 2021-01-27T13:29:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "modified": "2021-01-27T13:29:19.049432+0000", 2021-01-27T13:29:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "services": {} 2021-01-27T13:29:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-27T13:29:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: } 2021-01-27T13:29:31.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:31 smithi037 bash[9724]: audit 2021-01-27T13:29:31.343301+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.37:0/2293987049' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T13:29:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:mgr not available, waiting (1/15)... 2021-01-27T13:29:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-27T13:29:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:35.250 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: { 2021-01-27T13:29:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "fsid": "8e2eaa02-60a3-11eb-8f9a-001a4aab830c", 2021-01-27T13:29:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "health": { 2021-01-27T13:29:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-27T13:29:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "checks": {}, 2021-01-27T13:29:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "mutes": [] 2021-01-27T13:29:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-27T13:29:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum": [ 2021-01-27T13:29:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 0 2021-01-27T13:29:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-27T13:29:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "a" 2021-01-27T13:29:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum_age": 7, 2021-01-27T13:29:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "monmap": { 2021-01-27T13:29:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-27T13:29:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-27T13:29:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osdmap": { 2021-01-27T13:29:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:35.257 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-27T13:29:35.257 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-27T13:29:35.257 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-27T13:29:35.257 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-27T13:29:35.258 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-27T13:29:35.258 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-27T13:29:35.258 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:35.258 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "pgmap": { 2021-01-27T13:29:35.258 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-27T13:29:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-27T13:29:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-27T13:29:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-27T13:29:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-27T13:29:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-27T13:29:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-27T13:29:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-27T13:29:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "fsmap": { 2021-01-27T13:29:35.261 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:35.262 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-27T13:29:35.262 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-27T13:29:35.262 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:35.262 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-27T13:29:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "available": false, 2021-01-27T13:29:35.263 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-27T13:29:35.264 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "modules": [ 2021-01-27T13:29:35.264 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "iostat", 2021-01-27T13:29:35.264 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "restful" 2021-01-27T13:29:35.264 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:35.264 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "services": {} 2021-01-27T13:29:35.265 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:35.265 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "servicemap": { 2021-01-27T13:29:35.265 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:35.265 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "modified": "2021-01-27T13:29:19.049432+0000", 2021-01-27T13:29:35.265 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "services": {} 2021-01-27T13:29:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-27T13:29:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: } 2021-01-27T13:29:35.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:35 smithi037 bash[9724]: audit 2021-01-27T13:29:35.247851+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.37:0/900000540' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T13:29:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:mgr not available, waiting (2/15)... 2021-01-27T13:29:37.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: cluster 2021-01-27T13:29:37.259857+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2021-01-27T13:29:37.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: cluster 2021-01-27T13:29:37.265825+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00622356s) 2021-01-27T13:29:37.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.268165+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T13:29:37.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.268755+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T13:29:37.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.269414+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T13:29:37.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.270354+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T13:29:37.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.270923+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T13:29:37.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: cluster 2021-01-27T13:29:37.275915+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2021-01-27T13:29:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.296185+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' 2021-01-27T13:29:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.296503+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:29:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.299489+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:29:37.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:37 smithi037 bash[9724]: audit 2021-01-27T13:29:37.308145+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' 2021-01-27T13:29:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-27T13:29:38.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:38 smithi037 bash[9724]: audit 2021-01-27T13:29:37.314363+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.37:0/3910757379' entity='mgr.y' 2021-01-27T13:29:38.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:38 smithi037 bash[9724]: cluster 2021-01-27T13:29:38.272658+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01306s) 2021-01-27T13:29:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 2021-01-27T13:29:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: { 2021-01-27T13:29:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "fsid": "8e2eaa02-60a3-11eb-8f9a-001a4aab830c", 2021-01-27T13:29:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "health": { 2021-01-27T13:29:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-27T13:29:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "checks": {}, 2021-01-27T13:29:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "mutes": [] 2021-01-27T13:29:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-27T13:29:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum": [ 2021-01-27T13:29:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 0 2021-01-27T13:29:39.609 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:39.609 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-27T13:29:39.609 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "a" 2021-01-27T13:29:39.609 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "quorum_age": 11, 2021-01-27T13:29:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "monmap": { 2021-01-27T13:29:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-27T13:29:39.611 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-27T13:29:39.611 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:39.611 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osdmap": { 2021-01-27T13:29:39.611 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:39.611 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-27T13:29:39.612 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-27T13:29:39.612 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-27T13:29:39.612 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-27T13:29:39.616 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-27T13:29:39.617 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-27T13:29:39.617 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:39.617 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "pgmap": { 2021-01-27T13:29:39.617 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-27T13:29:39.617 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-27T13:29:39.618 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-27T13:29:39.618 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-27T13:29:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-27T13:29:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-27T13:29:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-27T13:29:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-27T13:29:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "fsmap": { 2021-01-27T13:29:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-27T13:29:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-27T13:29:39.621 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-27T13:29:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "available": true, 2021-01-27T13:29:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-27T13:29:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "modules": [ 2021-01-27T13:29:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "iostat", 2021-01-27T13:29:39.624 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "restful" 2021-01-27T13:29:39.624 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ], 2021-01-27T13:29:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "services": {} 2021-01-27T13:29:39.625 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:39.626 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "servicemap": { 2021-01-27T13:29:39.626 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-27T13:29:39.626 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "modified": "2021-01-27T13:29:19.049432+0000", 2021-01-27T13:29:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "services": {} 2021-01-27T13:29:39.627 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: }, 2021-01-27T13:29:39.628 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-27T13:29:39.628 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: } 2021-01-27T13:29:40.334 INFO:teuthology.orchestra.run.smithi037.stderr:mgr is available 2021-01-27T13:29:40.334 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config-key set mgr/cephadm/ssh_user root 2021-01-27T13:29:40.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:40 smithi037 bash[9724]: cluster 2021-01-27T13:29:39.325014+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-01-27T13:29:40.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:40 smithi037 bash[9724]: audit 2021-01-27T13:29:39.605644+0000 mon.a (mon.0) 24 : audit [DBG] from='client.? 172.21.15.37:0/508392882' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T13:29:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: set mgr/cephadm/ssh_user 2021-01-27T13:29:42.664 INFO:teuthology.orchestra.run.smithi037.stderr:Enabling cephadm module... 2021-01-27T13:29:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr module enable cephadm 2021-01-27T13:29:43.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:42 smithi037 bash[9724]: audit 2021-01-27T13:29:41.962317+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.37:0/4110988513' entity='client.admin' 2021-01-27T13:29:44.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:44 smithi037 bash[9724]: audit 2021-01-27T13:29:44.134705+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.37:0/3442626117' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-01-27T13:29:44.571 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:44 smithi037 bash[9955]: ignoring --setgroup ceph since I am not root 2021-01-27T13:29:44.935 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr stat 2021-01-27T13:29:45.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:45 smithi037 bash[9724]: audit 2021-01-27T13:29:44.191315+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.37:0/3442626117' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-01-27T13:29:45.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:45 smithi037 bash[9724]: cluster 2021-01-27T13:29:44.191468+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 6s) 2021-01-27T13:29:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: { 2021-01-27T13:29:46.403 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 5, 2021-01-27T13:29:46.404 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "available": true, 2021-01-27T13:29:46.404 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "active_name": "y", 2021-01-27T13:29:46.404 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_standby": 0 2021-01-27T13:29:46.405 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: } 2021-01-27T13:29:46.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:46 smithi037 bash[9724]: audit 2021-01-27T13:29:46.404368+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.37:0/4279584231' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-27T13:29:47.075 INFO:teuthology.orchestra.run.smithi037.stderr:Waiting for the mgr to restart... 2021-01-27T13:29:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:Waiting for mgr epoch 5... 2021-01-27T13:29:47.076 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 tell mgr mgr_status 2021-01-27T13:29:51.308 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: { 2021-01-27T13:29:51.308 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-01-27T13:29:51.309 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "initialized": true 2021-01-27T13:29:51.309 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: } 2021-01-27T13:29:51.532 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: cluster 2021-01-27T13:29:50.235486+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2021-01-27T13:29:51.533 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: cluster 2021-01-27T13:29:50.236102+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2021-01-27T13:29:51.533 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: cluster 2021-01-27T13:29:50.239719+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-01-27T13:29:51.533 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: cluster 2021-01-27T13:29:50.290120+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0541751s) 2021-01-27T13:29:51.534 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.294464+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T13:29:51.534 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.296345+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T13:29:51.534 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.296710+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T13:29:51.534 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.297084+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T13:29:51.534 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.297892+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T13:29:51.535 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.299256+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-27T13:29:51.535 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.299900+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-27T13:29:51.535 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.300448+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-27T13:29:51.535 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.300953+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-27T13:29:51.535 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: cluster 2021-01-27T13:29:50.304790+0000 mon.a (mon.0) 43 : cluster [INF] Manager daemon y is now available 2021-01-27T13:29:51.536 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.327396+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:51.536 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.333204+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:51.536 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.338856+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:51.536 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.475534+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:51.536 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.485044+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:51.537 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.492120+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:29:51.537 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:51 smithi037 bash[9724]: audit 2021-01-27T13:29:50.494321+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:29:52.084 INFO:teuthology.orchestra.run.smithi037.stderr:mgr epoch 5 is available 2021-01-27T13:29:52.084 INFO:teuthology.orchestra.run.smithi037.stderr:Setting orchestrator backend to cephadm... 2021-01-27T13:29:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 orch set backend cephadm 2021-01-27T13:29:52.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:52 smithi037 bash[9724]: audit 2021-01-27T13:29:51.294201+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-27T13:29:52.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:52 smithi037 bash[9724]: cluster 2021-01-27T13:29:51.295447+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.0595s) 2021-01-27T13:29:52.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:52 smithi037 bash[9724]: audit 2021-01-27T13:29:51.310641+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-27T13:29:53.556 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:53 smithi037 bash[9724]: cluster 2021-01-27T13:29:52.301104+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-01-27T13:29:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:Generating ssh key... 2021-01-27T13:29:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 cephadm generate-key 2021-01-27T13:29:54.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:54 smithi037 bash[9724]: audit 2021-01-27T13:29:53.488556+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:29:54.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:54 smithi037 bash[9724]: audit 2021-01-27T13:29:53.497945+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:54.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:54 smithi037 bash[9724]: audit 2021-01-27T13:29:53.506953+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:56.164 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: Generating public/private rsa key pair. 2021-01-27T13:29:56.164 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: Your identification has been saved in /tmp/tmpb5bxqtgw/key. 2021-01-27T13:29:56.165 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: Your public key has been saved in /tmp/tmpb5bxqtgw/key.pub. 2021-01-27T13:29:56.165 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: The key fingerprint is: 2021-01-27T13:29:56.165 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: SHA256:PmN32QtL60CiD50/q3R6FPwObXwZqdXEcdp2kJCE51Q ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:56.165 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: The key's randomart image is: 2021-01-27T13:29:56.166 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: +---[RSA 3072]----+ 2021-01-27T13:29:56.166 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | oo+E+o| 2021-01-27T13:29:56.166 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | . + .++| 2021-01-27T13:29:56.167 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | . + .++| 2021-01-27T13:29:56.167 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | o . +.o| 2021-01-27T13:29:56.167 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | S .= o o | 2021-01-27T13:29:56.168 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | + +o *oo | 2021-01-27T13:29:56.168 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | o O.++=.. | 2021-01-27T13:29:56.168 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | = Bo+.+ . | 2021-01-27T13:29:56.168 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: | +oo++ . | 2021-01-27T13:29:56.169 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:29:55 smithi037 bash[9955]: +----[SHA256]-----+ 2021-01-27T13:29:56.680 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 cephadm get-pub-key 2021-01-27T13:29:57.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:56 smithi037 bash[9724]: audit 2021-01-27T13:29:55.686446+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:29:57.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:56 smithi037 bash[9724]: cephadm 2021-01-27T13:29:55.686907+0000 mgr.y (mgr.14116) 5 : cephadm [INF] Generating ssh key... 2021-01-27T13:29:57.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:56 smithi037 bash[9724]: audit 2021-01-27T13:29:55.918355+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:57.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:56 smithi037 bash[9724]: audit 2021-01-27T13:29:55.921312+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:29:58.173 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDS/9GU4Rj7qkNQgDXMHS92ZRqKwabw8t0lmrjxHPW8oWNLFVmb6i0LDkQyV+GAptHHdSEnUoJhHq+So0QzQIAOf/jOTQIwWsUw/Slfr8ierWu4mllwVhSB+flk9M/x/rQRkNKzqeIru1hdxnKnt749blLo/1owOSF1/7nT+FueGrsMkvbgFQAlhTsMb/CBUBr4rsbhsIaMGrhXUt0ggP2hpwCMY0mh0cirpbxZAoE22iFHAKWFkgQdLfjbKW5l453knsazy3zrOqs+LAqRbHal7RSfCmAtun4L10Nwp2M8nlZhtbnvUnPOL83q/iYxJbC96nLq0c4idpdJTTvJP/cMSV39dvreCvmgwr1kG67cNBiga9srOSrvRxaDHnWp+dLf8kjVB0erjxYkdVCGKPYOaQ1o9km4oEX4XSzsRUzAnWjRER2ogwqn2lWEgOuH09iW9EBmKQbLLqvjQINV1Itleb2ZRBucFu3bzj6bRrf9ksGwyeEsPCrYZxKBh1dFV7k= ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:29:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-01-27T13:29:58.895 INFO:teuthology.orchestra.run.smithi037.stderr:Adding key to root@localhost's authorized_keys... 2021-01-27T13:29:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:Adding host smithi037... 2021-01-27T13:29:58.896 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 orch host add smithi037 2021-01-27T13:29:59.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:29:59 smithi037 bash[9724]: audit 2021-01-27T13:29:58.174721+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:30:00.822 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:30:00 smithi037 bash[9955]: Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2021-01-27T13:30:01.221 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: Added host 'smithi037' 2021-01-27T13:30:02.109 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config set mgr mgr/dashboard/ssl_server_port 8443 2021-01-27T13:30:02.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:02 smithi037 bash[9724]: audit 2021-01-27T13:30:00.451714+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:30:02.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:02 smithi037 bash[9724]: audit 2021-01-27T13:30:01.219040+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:30:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:02 smithi037 bash[9724]: cephadm 2021-01-27T13:30:01.219909+0000 mgr.y (mgr.14116) 8 : cephadm [INF] Added host smithi037 2021-01-27T13:30:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:02 smithi037 bash[9724]: audit 2021-01-27T13:30:01.655365+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:30:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:02 smithi037 bash[9724]: audit 2021-01-27T13:30:01.656935+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:30:03.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:03 smithi037 bash[9724]: audit 2021-01-27T13:30:02.414109+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' 2021-01-27T13:30:03.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:03 smithi037 bash[9724]: audit 2021-01-27T13:30:02.415373+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14116 172.21.15.37:0/864990764' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:30:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:Enabling the dashboard module... 2021-01-27T13:30:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr module enable dashboard 2021-01-27T13:30:05.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:05 smithi037 bash[9724]: audit 2021-01-27T13:30:04.160218+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.37:0/4162730717' entity='client.admin' 2021-01-27T13:30:07.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:06 smithi037 bash[9724]: audit 2021-01-27T13:30:06.913428+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.37:0/1371630236' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-01-27T13:30:07.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:30:07 smithi037 bash[9955]: ignoring --setuser ceph since I am not root 2021-01-27T13:30:07.324 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:30:07 smithi037 bash[9955]: ignoring --setgroup ceph since I am not root 2021-01-27T13:30:07.737 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr stat 2021-01-27T13:30:08.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:07 smithi037 bash[9724]: audit 2021-01-27T13:30:06.967840+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.37:0/1371630236' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-01-27T13:30:08.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:07 smithi037 bash[9724]: cluster 2021-01-27T13:30:06.967905+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e9: y(active, since 16s) 2021-01-27T13:30:09.244 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: { 2021-01-27T13:30:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "epoch": 9, 2021-01-27T13:30:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "available": true, 2021-01-27T13:30:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "active_name": "y", 2021-01-27T13:30:09.246 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "num_standby": 0 2021-01-27T13:30:09.246 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: } 2021-01-27T13:30:09.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:09 smithi037 bash[9724]: audit 2021-01-27T13:30:09.244142+0000 mon.a (mon.0) 66 : audit [DBG] from='client.? 172.21.15.37:0/398708118' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-27T13:30:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:Waiting for the mgr to restart... 2021-01-27T13:30:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:Waiting for mgr epoch 9... 2021-01-27T13:30:09.986 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 tell mgr mgr_status 2021-01-27T13:30:14.286 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:14 smithi037 bash[9724]: cluster 2021-01-27T13:30:13.087300+0000 mon.a (mon.0) 67 : cluster [INF] Active manager daemon y restarted 2021-01-27T13:30:14.286 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:14 smithi037 bash[9724]: cluster 2021-01-27T13:30:13.088035+0000 mon.a (mon.0) 68 : cluster [INF] Activating manager daemon y 2021-01-27T13:30:14.287 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:14 smithi037 bash[9724]: cluster 2021-01-27T13:30:13.091340+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-01-27T13:30:14.573 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:30:14 smithi037 bash[9955]: Warning: Permanently added 'smithi037,172.21.15.37' (ECDSA) to the list of known hosts. 2021-01-27T13:30:15.057 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: { 2021-01-27T13:30:15.058 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-01-27T13:30:15.058 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: "initialized": true 2021-01-27T13:30:15.058 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: } 2021-01-27T13:30:15.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: cluster 2021-01-27T13:30:14.034253+0000 mon.a (mon.0) 70 : cluster [DBG] mgrmap e10: y(active, starting, since 0.946302s) 2021-01-27T13:30:15.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.038705+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T13:30:15.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.040414+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T13:30:15.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.040982+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T13:30:15.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.041334+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T13:30:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.042177+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T13:30:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.043628+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi037"}]: dispatch 2021-01-27T13:30:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.044159+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-01-27T13:30:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.044633+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-01-27T13:30:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.045107+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-01-27T13:30:15.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.045577+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-01-27T13:30:15.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.046102+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-27T13:30:15.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.046599+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-27T13:30:15.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.047101+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-27T13:30:15.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.047565+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-27T13:30:15.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: cluster 2021-01-27T13:30:14.051243+0000 mon.a (mon.0) 85 : cluster [INF] Manager daemon y is now available 2021-01-27T13:30:15.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.250549+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:30:15.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.254002+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:30:15.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:15 smithi037 bash[9724]: audit 2021-01-27T13:30:14.466535+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:30:16.187 INFO:teuthology.orchestra.run.smithi037.stderr:mgr epoch 9 is available 2021-01-27T13:30:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:Generating a dashboard self-signed certificate... 2021-01-27T13:30:16.188 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 dashboard create-self-signed-cert 2021-01-27T13:30:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:16 smithi037 bash[9724]: cluster 2021-01-27T13:30:15.044676+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e11: y(active, since 1.95674s) 2021-01-27T13:30:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:16 smithi037 bash[9724]: audit 2021-01-27T13:30:15.045169+0000 mgr.y (mgr.14138) 1 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-27T13:30:16.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:16 smithi037 bash[9724]: audit 2021-01-27T13:30:15.057333+0000 mgr.y (mgr.14138) 2 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-27T13:30:16.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:16 smithi037 bash[9724]: audit 2021-01-27T13:30:15.188802+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:16.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:16 smithi037 bash[9724]: audit 2021-01-27T13:30:15.189929+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:30:17.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:17 smithi037 bash[9724]: cluster 2021-01-27T13:30:16.047165+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-01-27T13:30:18.123 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: Self-signed certificate created 2021-01-27T13:30:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:Creating initial admin user... 2021-01-27T13:30:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpdgd63k75:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-01-27T13:30:19.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:19 smithi037 bash[9724]: audit 2021-01-27T13:30:18.053352+0000 mgr.y (mgr.14138) 3 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:30:19.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:19 smithi037 bash[9724]: audit 2021-01-27T13:30:18.118485+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:19.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:19 smithi037 bash[9724]: audit 2021-01-27T13:30:18.122893+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$Cm1uXUURObfhxAAAtmBAG.Qo3oX4NQWuChonuM1AyqBZHY5yZBkNO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1611754220, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-01-27T13:30:21.557 INFO:teuthology.orchestra.run.smithi037.stderr:Fetching dashboard port number... 2021-01-27T13:30:21.557 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi037 -v /var/log/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp7co1v49_:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpgf8caaqs:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config get mgr mgr/dashboard/ssl_server_port 2021-01-27T13:30:22.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:21 smithi037 bash[9724]: audit 2021-01-27T13:30:20.524368+0000 mgr.y (mgr.14138) 4 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:30:22.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:21 smithi037 bash[9724]: audit 2021-01-27T13:30:20.784767+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:/usr/bin/ceph: 8443 2021-01-27T13:30:23.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:22 smithi037 bash[9724]: cluster 2021-01-27T13:30:21.789049+0000 mon.a (mon.0) 96 : cluster [DBG] mgrmap e13: y(active, since 8s) 2021-01-27T13:30:23.743 INFO:teuthology.orchestra.run.smithi037.stderr:firewalld does not appear to be present 2021-01-27T13:30:23.743 INFO:teuthology.orchestra.run.smithi037.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-01-27T13:30:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:Ceph Dashboard is now available at: 2021-01-27T13:30:23.747 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:30:23.747 INFO:teuthology.orchestra.run.smithi037.stderr: URL: https://smithi037.front.sepia.ceph.com:8443/ 2021-01-27T13:30:23.747 INFO:teuthology.orchestra.run.smithi037.stderr: User: admin 2021-01-27T13:30:23.748 INFO:teuthology.orchestra.run.smithi037.stderr: Password: vbg3za03s0 2021-01-27T13:30:23.748 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:30:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:You can access the Ceph CLI with: 2021-01-27T13:30:23.748 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:30:23.748 INFO:teuthology.orchestra.run.smithi037.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-01-27T13:30:23.749 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:30:23.749 INFO:teuthology.orchestra.run.smithi037.stderr:Please consider enabling telemetry to help improve Ceph: 2021-01-27T13:30:23.749 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:30:23.749 INFO:teuthology.orchestra.run.smithi037.stderr: ceph telemetry on 2021-01-27T13:30:23.750 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:30:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:For more information see: 2021-01-27T13:30:23.750 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:30:23.750 INFO:teuthology.orchestra.run.smithi037.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-01-27T13:30:23.750 INFO:teuthology.orchestra.run.smithi037.stderr: 2021-01-27T13:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:Bootstrap complete. 2021-01-27T13:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:Releasing lock 139797021006912 on /run/cephadm/8e2eaa02-60a3-11eb-8f9a-001a4aab830c.lock 2021-01-27T13:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:Lock 139797021006912 released on /run/cephadm/8e2eaa02-60a3-11eb-8f9a-001a4aab830c.lock 2021-01-27T13:30:23.778 INFO:tasks.cephadm:Fetching config... 2021-01-27T13:30:23.779 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:30:23.780 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-01-27T13:30:23.785 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-01-27T13:30:23.786 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:30:23.786 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-01-27T13:30:23.793 INFO:tasks.cephadm:Fetching mon keyring... 2021-01-27T13:30:23.793 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:30:23.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-01-27T13:30:23.806 INFO:tasks.cephadm:Fetching pub ssh key... 2021-01-27T13:30:23.807 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:30:23.807 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-01-27T13:30:23.812 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-01-27T13:30:23.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDS/9GU4Rj7qkNQgDXMHS92ZRqKwabw8t0lmrjxHPW8oWNLFVmb6i0LDkQyV+GAptHHdSEnUoJhHq+So0QzQIAOf/jOTQIwWsUw/Slfr8ierWu4mllwVhSB+flk9M/x/rQRkNKzqeIru1hdxnKnt749blLo/1owOSF1/7nT+FueGrsMkvbgFQAlhTsMb/CBUBr4rsbhsIaMGrhXUt0ggP2hpwCMY0mh0cirpbxZAoE22iFHAKWFkgQdLfjbKW5l453knsazy3zrOqs+LAqRbHal7RSfCmAtun4L10Nwp2M8nlZhtbnvUnPOL83q/iYxJbC96nLq0c4idpdJTTvJP/cMSV39dvreCvmgwr1kG67cNBiga9srOSrvRxaDHnWp+dLf8kjVB0erjxYkdVCGKPYOaQ1o9km4oEX4XSzsRUzAnWjRER2ogwqn2lWEgOuH09iW9EBmKQbLLqvjQINV1Itleb2ZRBucFu3bzj6bRrf9ksGwyeEsPCrYZxKBh1dFV7k= ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-27T13:30:23.837 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDS/9GU4Rj7qkNQgDXMHS92ZRqKwabw8t0lmrjxHPW8oWNLFVmb6i0LDkQyV+GAptHHdSEnUoJhHq+So0QzQIAOf/jOTQIwWsUw/Slfr8ierWu4mllwVhSB+flk9M/x/rQRkNKzqeIru1hdxnKnt749blLo/1owOSF1/7nT+FueGrsMkvbgFQAlhTsMb/CBUBr4rsbhsIaMGrhXUt0ggP2hpwCMY0mh0cirpbxZAoE22iFHAKWFkgQdLfjbKW5l453knsazy3zrOqs+LAqRbHal7RSfCmAtun4L10Nwp2M8nlZhtbnvUnPOL83q/iYxJbC96nLq0c4idpdJTTvJP/cMSV39dvreCvmgwr1kG67cNBiga9srOSrvRxaDHnWp+dLf8kjVB0erjxYkdVCGKPYOaQ1o9km4oEX4XSzsRUzAnWjRER2ogwqn2lWEgOuH09iW9EBmKQbLLqvjQINV1Itleb2ZRBucFu3bzj6bRrf9ksGwyeEsPCrYZxKBh1dFV7k= ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:30:23.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDS/9GU4Rj7qkNQgDXMHS92ZRqKwabw8t0lmrjxHPW8oWNLFVmb6i0LDkQyV+GAptHHdSEnUoJhHq+So0QzQIAOf/jOTQIwWsUw/Slfr8ierWu4mllwVhSB+flk9M/x/rQRkNKzqeIru1hdxnKnt749blLo/1owOSF1/7nT+FueGrsMkvbgFQAlhTsMb/CBUBr4rsbhsIaMGrhXUt0ggP2hpwCMY0mh0cirpbxZAoE22iFHAKWFkgQdLfjbKW5l453knsazy3zrOqs+LAqRbHal7RSfCmAtun4L10Nwp2M8nlZhtbnvUnPOL83q/iYxJbC96nLq0c4idpdJTTvJP/cMSV39dvreCvmgwr1kG67cNBiga9srOSrvRxaDHnWp+dLf8kjVB0erjxYkdVCGKPYOaQ1o9km4oEX4XSzsRUzAnWjRER2ogwqn2lWEgOuH09iW9EBmKQbLLqvjQINV1Itleb2ZRBucFu3bzj6bRrf9ksGwyeEsPCrYZxKBh1dFV7k= ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-27T13:30:23.871 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDS/9GU4Rj7qkNQgDXMHS92ZRqKwabw8t0lmrjxHPW8oWNLFVmb6i0LDkQyV+GAptHHdSEnUoJhHq+So0QzQIAOf/jOTQIwWsUw/Slfr8ierWu4mllwVhSB+flk9M/x/rQRkNKzqeIru1hdxnKnt749blLo/1owOSF1/7nT+FueGrsMkvbgFQAlhTsMb/CBUBr4rsbhsIaMGrhXUt0ggP2hpwCMY0mh0cirpbxZAoE22iFHAKWFkgQdLfjbKW5l453knsazy3zrOqs+LAqRbHal7RSfCmAtun4L10Nwp2M8nlZhtbnvUnPOL83q/iYxJbC96nLq0c4idpdJTTvJP/cMSV39dvreCvmgwr1kG67cNBiga9srOSrvRxaDHnWp+dLf8kjVB0erjxYkdVCGKPYOaQ1o9km4oEX4XSzsRUzAnWjRER2ogwqn2lWEgOuH09iW9EBmKQbLLqvjQINV1Itleb2ZRBucFu3bzj6bRrf9ksGwyeEsPCrYZxKBh1dFV7k= ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:30:23.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-01-27T13:30:24.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:23 smithi037 bash[9724]: audit 2021-01-27T13:30:23.019274+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.37:0/2278939323' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-01-27T13:30:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: audit 2021-01-27T13:30:28.032855+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:30:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: audit 2021-01-27T13:30:28.385687+0000 mon.a (mon.0) 99 : audit [INF] from='client.? 172.21.15.37:0/3346839005' entity='client.admin' 2021-01-27T13:30:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: audit 2021-01-27T13:30:28.390484+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:29.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: cephadm 2021-01-27T13:30:28.391687+0000 mgr.y (mgr.14138) 5 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:30:29.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: audit 2021-01-27T13:30:28.883707+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:29.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: cephadm 2021-01-27T13:30:28.884467+0000 mgr.y (mgr.14138) 6 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-01-27T13:30:29.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: audit 2021-01-27T13:30:28.885059+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:30:29.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: audit 2021-01-27T13:30:28.886345+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:30:29.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: cephadm 2021-01-27T13:30:28.887581+0000 mgr.y (mgr.14138) 7 : cephadm [INF] Reconfiguring daemon mon.a on smithi037 2021-01-27T13:30:29.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:29 smithi037 bash[9724]: audit 2021-01-27T13:30:28.888499+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T13:30:29.566 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi099 2021-01-27T13:30:29.566 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:30:29.567 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.conf 2021-01-27T13:30:29.574 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:30:29.575 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T13:30:29.625 INFO:tasks.cephadm:Adding host smithi099 to orchestrator... 2021-01-27T13:30:29.626 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch host add smithi099 2021-01-27T13:30:35.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:35 smithi037 bash[9724]: cluster 2021-01-27T13:30:34.041894+0000 mgr.y (mgr.14138) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:35.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:35 smithi037 bash[9724]: audit 2021-01-27T13:30:34.301271+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:35.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:35 smithi037 bash[9724]: cephadm 2021-01-27T13:30:34.301994+0000 mgr.y (mgr.14138) 9 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-01-27T13:30:35.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:35 smithi037 bash[9724]: audit 2021-01-27T13:30:34.302458+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T13:30:35.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:35 smithi037 bash[9724]: audit 2021-01-27T13:30:34.303772+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:30:35.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:35 smithi037 bash[9724]: cephadm 2021-01-27T13:30:34.304959+0000 mgr.y (mgr.14138) 10 : cephadm [INF] Reconfiguring daemon mgr.y on smithi037 2021-01-27T13:30:35.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:35 smithi037 bash[9724]: audit 2021-01-27T13:30:34.306044+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T13:30:37.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:37 smithi037 bash[9724]: cluster 2021-01-27T13:30:36.042378+0000 mgr.y (mgr.14138) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:37 smithi037 bash[9724]: audit 2021-01-27T13:30:36.479119+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:37 smithi037 bash[9724]: audit 2021-01-27T13:30:36.483035+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:30:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:37 smithi037 bash[9724]: audit 2021-01-27T13:30:37.228383+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:37.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:37 smithi037 bash[9724]: audit 2021-01-27T13:30:37.233780+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:39.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:39 smithi037 bash[9724]: cluster 2021-01-27T13:30:38.042804+0000 mgr.y (mgr.14138) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:41.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:41 smithi037 bash[9724]: cluster 2021-01-27T13:30:40.043202+0000 mgr.y (mgr.14138) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:43.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:43 smithi037 bash[9724]: cluster 2021-01-27T13:30:42.043607+0000 mgr.y (mgr.14138) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:45.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:45 smithi037 bash[9724]: cluster 2021-01-27T13:30:44.044007+0000 mgr.y (mgr.14138) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:47.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:47 smithi037 bash[9724]: cluster 2021-01-27T13:30:46.044425+0000 mgr.y (mgr.14138) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:49.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:49 smithi037 bash[9724]: cluster 2021-01-27T13:30:48.044827+0000 mgr.y (mgr.14138) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:51.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:51 smithi037 bash[9724]: cluster 2021-01-27T13:30:50.045232+0000 mgr.y (mgr.14138) 18 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:53.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:53 smithi037 bash[9724]: cluster 2021-01-27T13:30:52.045675+0000 mgr.y (mgr.14138) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:55.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:55 smithi037 bash[9724]: cluster 2021-01-27T13:30:54.046041+0000 mgr.y (mgr.14138) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:56.822 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:30:56 smithi037 bash[9955]: Warning: Permanently added 'smithi099,172.21.15.99' (ECDSA) to the list of known hosts. 2021-01-27T13:30:57.259 INFO:teuthology.orchestra.run.smithi099.stdout:Added host 'smithi099' 2021-01-27T13:30:57.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:57 smithi037 bash[9724]: cluster 2021-01-27T13:30:56.046416+0000 mgr.y (mgr.14138) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:30:57.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:57 smithi037 bash[9724]: audit 2021-01-27T13:30:56.470773+0000 mgr.y (mgr.14138) 22 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:30:57.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch host ls --format=json 2021-01-27T13:30:58.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:58 smithi037 bash[9724]: audit 2021-01-27T13:30:57.256819+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:58.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:58 smithi037 bash[9724]: cephadm 2021-01-27T13:30:57.257895+0000 mgr.y (mgr.14138) 23 : cephadm [INF] Added host smithi099 2021-01-27T13:30:58.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:58 smithi037 bash[9724]: audit 2021-01-27T13:30:57.262328+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:30:58.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:58 smithi037 bash[9724]: audit 2021-01-27T13:30:57.697272+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:58.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:58 smithi037 bash[9724]: audit 2021-01-27T13:30:57.698274+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:30:58.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:58 smithi037 bash[9724]: audit 2021-01-27T13:30:57.980617+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:58.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:58 smithi037 bash[9724]: audit 2021-01-27T13:30:58.048064+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:30:58.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:58 smithi037 bash[9724]: audit 2021-01-27T13:30:58.049772+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:30:59.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:30:59 smithi037 bash[9724]: cluster 2021-01-27T13:30:58.046817+0000 mgr.y (mgr.14138) 24 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:01.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:01 smithi037 bash[9724]: cluster 2021-01-27T13:31:00.047672+0000 mgr.y (mgr.14138) 25 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:01.960 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-01-27T13:31:01.960 INFO:teuthology.orchestra.run.smithi099.stdout:[{"addr": "smithi037", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "smithi099", "hostname": "smithi099", "labels": [], "status": ""}] 2021-01-27T13:31:02.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:02 smithi037 bash[9724]: audit 2021-01-27T13:31:01.959513+0000 mgr.y (mgr.14138) 26 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T13:31:02.609 INFO:tasks.cephadm:Setting crush tunables to default 2021-01-27T13:31:02.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd crush tunables default 2021-01-27T13:31:03.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:03 smithi037 bash[9724]: cluster 2021-01-27T13:31:02.048233+0000 mgr.y (mgr.14138) 27 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:04.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:04 smithi037 bash[9724]: audit 2021-01-27T13:31:03.503194+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:04.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:04 smithi037 bash[9724]: audit 2021-01-27T13:31:03.871784+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:04.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:04 smithi037 bash[9724]: cephadm 2021-01-27T13:31:03.872660+0000 mgr.y (mgr.14138) 28 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:31:05.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:05 smithi037 bash[9724]: cluster 2021-01-27T13:31:04.048562+0000 mgr.y (mgr.14138) 29 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:05.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:05 smithi037 bash[9724]: audit 2021-01-27T13:31:04.308447+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:05.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:05 smithi037 bash[9724]: audit 2021-01-27T13:31:04.314042+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:06.320 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2021-01-27T13:31:06.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:06 smithi037 bash[9724]: audit 2021-01-27T13:31:06.134788+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.37:0/611222825' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-01-27T13:31:07.045 INFO:tasks.cephadm:Adding mon.c on smithi037 2021-01-27T13:31:07.045 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add mon 'smithi037:[v2:172.21.15.37:3301,v1:172.21.15.37:6790]=c' 2021-01-27T13:31:07.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:07 smithi037 bash[9724]: cluster 2021-01-27T13:31:06.048889+0000 mgr.y (mgr.14138) 30 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:07.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:07 smithi037 bash[9724]: audit 2021-01-27T13:31:06.315960+0000 mon.a (mon.0) 125 : audit [INF] from='client.? 172.21.15.37:0/611222825' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-01-27T13:31:07.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:07 smithi037 bash[9724]: cluster 2021-01-27T13:31:06.316092+0000 mon.a (mon.0) 126 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-01-27T13:31:07.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:07 smithi037 bash[9724]: audit 2021-01-27T13:31:06.316709+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-01-27T13:31:08.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:08 smithi037 bash[9724]: audit 2021-01-27T13:31:07.323585+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-01-27T13:31:08.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:08 smithi037 bash[9724]: cluster 2021-01-27T13:31:07.323752+0000 mon.a (mon.0) 129 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-01-27T13:31:08.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:08 smithi037 bash[9724]: audit 2021-01-27T13:31:07.325189+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-01-27T13:31:09.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:09 smithi037 bash[9724]: cluster 2021-01-27T13:31:08.049303+0000 mgr.y (mgr.14138) 31 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:09.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:09 smithi037 bash[9724]: audit 2021-01-27T13:31:08.325174+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-01-27T13:31:09.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:09 smithi037 bash[9724]: cluster 2021-01-27T13:31:08.325301+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T13:31:11.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:11 smithi037 bash[9724]: cluster 2021-01-27T13:31:10.049870+0000 mgr.y (mgr.14138) 32 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:11.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:11 smithi037 bash[9724]: audit 2021-01-27T13:31:10.532075+0000 mgr.y (mgr.14138) 33 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi037:[v2:172.21.15.37:3301,v1:172.21.15.37:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:11.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:11 smithi037 bash[9724]: audit 2021-01-27T13:31:10.536568+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:11.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:11 smithi037 bash[9724]: audit 2021-01-27T13:31:10.538425+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:11.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:11 smithi037 bash[9724]: cephadm 2021-01-27T13:31:10.539709+0000 mgr.y (mgr.14138) 34 : cephadm [INF] Deploying daemon mon.c on smithi037 2021-01-27T13:31:11.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:11 smithi037 bash[9724]: audit 2021-01-27T13:31:10.540571+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T13:31:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:13 smithi037 bash[9724]: cluster 2021-01-27T13:31:12.050388+0000 mgr.y (mgr.14138) 35 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:14.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:14 smithi037 bash[9724]: audit 2021-01-27T13:31:14.253692+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:31:14.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:14 smithi037 bash[9724]: audit 2021-01-27T13:31:14.256689+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:31:15.285 INFO:teuthology.orchestra.run.smithi037.stdout:Deployed mon.c on host 'smithi037' 2021-01-27T13:31:15.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:15 smithi037 bash[9724]: cluster 2021-01-27T13:31:14.050798+0000 mgr.y (mgr.14138) 36 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:15.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:15 smithi037 bash[9724]: audit 2021-01-27T13:31:15.282558+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:15.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:15 smithi037 bash[9724]: audit 2021-01-27T13:31:15.285775+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:16.895 DEBUG:teuthology.orchestra.run.smithi037:mon.c> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.c.service 2021-01-27T13:31:16.897 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-01-27T13:31:16.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph mon dump -f json 2021-01-27T13:31:16.970 INFO:journalctl@ceph.mon.c.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:31:17.143 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T13:31:17.144 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-27T13:31:17.144 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 0 pidfile_write: ignore empty --pid-file 2021-01-27T13:31:17.144 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 0 load: jerasure load: lrc load: isa 2021-01-27T13:31:17.145 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T13:31:17.145 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T13:31:17.145 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T13:31:17.145 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: DB SUMMARY 2021-01-27T13:31:17.145 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T13:31:17.146 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T13:31:17.146 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-27T13:31:17.146 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-01-27T13:31:17.146 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 511 ; 2021-01-27T13:31:17.147 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T13:31:17.147 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T13:31:17.147 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T13:31:17.148 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.env: 0x55fa9b3b91c0 2021-01-27T13:31:17.149 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.fs: Posix File System 2021-01-27T13:31:17.149 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.info_log: 0x55fa9ca15e80 2021-01-27T13:31:17.149 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T13:31:17.149 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.statistics: (nil) 2021-01-27T13:31:17.150 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.use_fsync: 0 2021-01-27T13:31:17.150 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T13:31:17.151 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T13:31:17.151 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T13:31:17.151 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T13:31:17.151 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T13:31:17.152 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T13:31:17.152 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T13:31:17.152 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T13:31:17.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T13:31:17.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T13:31:17.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T13:31:17.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.db_log_dir: 2021-01-27T13:31:17.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-01-27T13:31:17.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T13:31:17.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T13:31:17.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T13:31:17.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T13:31:17.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T13:31:17.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T13:31:17.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T13:31:17.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T13:31:17.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T13:31:17.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T13:31:17.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.write_buffer_manager: 0x55fa9ca6fc80 2021-01-27T13:31:17.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T13:31:17.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T13:31:17.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T13:31:17.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T13:31:17.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T13:31:17.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T13:31:17.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T13:31:17.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T13:31:17.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T13:31:17.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.unordered_write: 0 2021-01-27T13:31:17.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T13:31:17.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T13:31:17.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T13:31:17.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T13:31:17.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.row_cache: None 2021-01-27T13:31:17.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.wal_filter: None 2021-01-27T13:31:17.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T13:31:17.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T13:31:17.580 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T13:31:17.580 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T13:31:17.580 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T13:31:17.580 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T13:31:17.580 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T13:31:17.581 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T13:31:17.581 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T13:31:17.581 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T13:31:17.581 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T13:31:17.582 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T13:31:17.582 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T13:31:17.582 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T13:31:17.582 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T13:31:17.582 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T13:31:17.583 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T13:31:17.583 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T13:31:17.583 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T13:31:17.583 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T13:31:17.583 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T13:31:17.584 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_open_files: -1 2021-01-27T13:31:17.585 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T13:31:17.585 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T13:31:17.586 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T13:31:17.586 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T13:31:17.586 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Compression algorithms supported: 2021-01-27T13:31:17.586 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T13:31:17.586 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: kZSTD supported: 0 2021-01-27T13:31:17.587 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T13:31:17.587 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T13:31:17.587 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T13:31:17.587 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T13:31:17.588 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T13:31:17.588 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T13:31:17.588 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T13:31:17.588 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2021-01-27T13:31:17.588 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T13:31:17.589 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T13:31:17.589 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.merge_operator: 2021-01-27T13:31:17.589 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_filter: None 2021-01-27T13:31:17.589 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T13:31:17.589 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T13:31:17.590 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T13:31:17.590 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fa9c9be1e0) 2021-01-27T13:31:17.590 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: cache_index_and_filter_blocks: 1 2021-01-27T13:31:17.590 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T13:31:17.590 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T13:31:17.591 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: pin_top_level_index_and_filter: 1 2021-01-27T13:31:17.591 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: index_type: 0 2021-01-27T13:31:17.591 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: data_block_index_type: 0 2021-01-27T13:31:17.591 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: index_shortening: 1 2021-01-27T13:31:17.591 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T13:31:17.592 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: hash_index_allow_collision: 1 2021-01-27T13:31:17.592 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: checksum: 1 2021-01-27T13:31:17.592 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: no_block_cache: 0 2021-01-27T13:31:17.592 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: block_cache: 0x55fa9c9f6510 2021-01-27T13:31:17.592 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: block_cache_name: BinnedLRUCache 2021-01-27T13:31:17.593 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: block_cache_options: 2021-01-27T13:31:17.593 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: capacity : 536870912 2021-01-27T13:31:17.593 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: num_shard_bits : 4 2021-01-27T13:31:17.593 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: strict_capacity_limit : 0 2021-01-27T13:31:17.593 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: high_pri_pool_ratio: 0.000 2021-01-27T13:31:17.594 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: block_cache_compressed: (nil) 2021-01-27T13:31:17.594 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: persistent_cache: (nil) 2021-01-27T13:31:17.594 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: block_size: 4096 2021-01-27T13:31:17.594 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: block_size_deviation: 10 2021-01-27T13:31:17.594 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: block_restart_interval: 16 2021-01-27T13:31:17.595 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: index_block_restart_interval: 1 2021-01-27T13:31:17.595 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: metadata_block_size: 4096 2021-01-27T13:31:17.595 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: partition_filters: 0 2021-01-27T13:31:17.595 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: use_delta_encoding: 1 2021-01-27T13:31:17.595 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T13:31:17.596 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: whole_key_filtering: 1 2021-01-27T13:31:17.596 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: verify_compression: 0 2021-01-27T13:31:17.596 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: read_amp_bytes_per_bit: 0 2021-01-27T13:31:17.596 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: format_version: 2 2021-01-27T13:31:17.596 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: enable_index_compression: 1 2021-01-27T13:31:17.597 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: block_align: 0 2021-01-27T13:31:17.597 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T13:31:17.597 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T13:31:17.597 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compression: NoCompression 2021-01-27T13:31:17.597 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T13:31:17.598 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T13:31:17.598 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T13:31:17.598 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.num_levels: 7 2021-01-27T13:31:17.598 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T13:31:17.598 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T13:31:17.599 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T13:31:17.599 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T13:31:17.599 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T13:31:17.599 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T13:31:17.599 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T13:31:17.600 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T13:31:17.600 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T13:31:17.600 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T13:31:17.600 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T13:31:17.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T13:31:17.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T13:31:17.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T13:31:17.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T13:31:17.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T13:31:17.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T13:31:17.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T13:31:17.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T13:31:17.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T13:31:17.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T13:31:17.603 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T13:31:17.603 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T13:31:17.603 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T13:31:17.603 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T13:31:17.603 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T13:31:17.604 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T13:31:17.604 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T13:31:17.604 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T13:31:17.604 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T13:31:17.604 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T13:31:17.605 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T13:31:17.605 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T13:31:17.605 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T13:31:17.605 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T13:31:17.605 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T13:31:17.606 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T13:31:17.606 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T13:31:17.606 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T13:31:17.606 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T13:31:17.606 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T13:31:17.607 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T13:31:17.607 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T13:31:17.607 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T13:31:17.607 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T13:31:17.608 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T13:31:17.608 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T13:31:17.608 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T13:31:17.608 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T13:31:17.609 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T13:31:17.609 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T13:31:17.609 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T13:31:17.609 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T13:31:17.609 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T13:31:17.610 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T13:31:17.610 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T13:31:17.610 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T13:31:17.610 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T13:31:17.610 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T13:31:17.611 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.ttl: 2592000 2021-01-27T13:31:17.611 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T13:31:17.611 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T13:31:17.611 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T13:31:17.611 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754277144778, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-27T13:31:17.612 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-27T13:31:17.612 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T13:31:17.612 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754277145539, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611754277, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T13:31:17.612 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.137+0000 7f0380628700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-27T13:31:17.612 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.141+0000 7f0380628700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754277146381, "job": 1, "event": "recovery_finished"} 2021-01-27T13:31:17.613 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.141+0000 7f0380628700 4 rocksdb: DB pointer 0x55fa9cab5800 2021-01-27T13:31:17.613 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.141+0000 7f0367449700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T13:31:17.613 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.141+0000 7f0367449700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T13:31:17.613 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ** DB Stats ** 2021-01-27T13:31:17.613 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:31:17.614 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T13:31:17.614 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T13:31:17.614 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T13:31:17.614 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T13:31:17.615 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T13:31:17.615 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T13:31:17.615 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ** Compaction Stats [default] ** 2021-01-27T13:31:17.615 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:31:17.615 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:31:17.616 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:17.616 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:17.616 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:17.616 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ** Compaction Stats [default] ** 2021-01-27T13:31:17.616 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:31:17.617 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:31:17.617 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:17.617 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:31:17.617 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T13:31:17.618 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T13:31:17.618 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T13:31:17.618 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T13:31:17.618 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T13:31:17.619 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Cumulative compaction: 0.00 GB write, 0.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:31:17.619 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Interval compaction: 0.00 GB write, 0.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:31:17.619 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T13:31:17.619 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T13:31:17.619 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ** Compaction Stats [default] ** 2021-01-27T13:31:17.620 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:31:17.620 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:31:17.620 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:17.620 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:17.620 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T13:31:17.621 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ** Compaction Stats [default] ** 2021-01-27T13:31:17.621 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:31:17.621 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:31:17.621 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:17.621 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:31:17.622 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T13:31:17.622 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T13:31:17.622 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T13:31:17.622 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T13:31:17.622 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T13:31:17.623 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Cumulative compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:31:17.623 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:31:17.623 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T13:31:17.623 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T13:31:17.624 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.141+0000 7f0380628700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2021-01-27T13:31:17.624 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.141+0000 7f0380628700 0 using public_addrv [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2021-01-27T13:31:17.624 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.141+0000 7f0380628700 0 starting mon.c rank -1 at public addrs [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] at bind addrs [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:31:17.624 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.141+0000 7f0380628700 1 mon.c@-1(???) e0 preinit fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:31:17.624 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 0 mon.c@-1(synchronizing).mds e1 new map 2021-01-27T13:31:17.625 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 0 mon.c@-1(synchronizing).mds e1 print_map 2021-01-27T13:31:17.625 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: e1 2021-01-27T13:31:17.625 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T13:31:17.625 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T13:31:17.625 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: legacy client fscid: -1 2021-01-27T13:31:17.626 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: 2021-01-27T13:31:17.626 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: No filesystems configured 2021-01-27T13:31:17.626 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-27T13:31:17.626 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-27T13:31:17.627 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-27T13:31:17.627 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-27T13:31:17.627 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-27T13:31:17.627 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-27T13:31:17.628 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.165+0000 7f0369c4e700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-27T13:31:17.628 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.169+0000 7f0369c4e700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-27T13:31:17.628 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.169+0000 7f0369c4e700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-27T13:31:17.628 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.169+0000 7f0369c4e700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T13:31:17.628 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.169+0000 7f0369c4e700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T13:31:17.629 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.169+0000 7f0369c4e700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T13:31:17.629 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: cluster 2021-01-27T13:31:14.050798+0000 mgr.y (mgr.14138) 36 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:17.629 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: audit 2021-01-27T13:31:15.282558+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:17.629 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: audit 2021-01-27T13:31:15.285775+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:17.629 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.169+0000 7f0369c4e700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-01-27T13:31:17.630 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta expand map: {default=false} 2021-01-27T13:31:17.630 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta from 'false' to 'false' 2021-01-27T13:31:17.630 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta expanded map: {default=false} 2021-01-27T13:31:17.630 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta expand map: {default=info} 2021-01-27T13:31:17.630 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta from 'info' to 'info' 2021-01-27T13:31:17.631 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta expanded map: {default=info} 2021-01-27T13:31:17.631 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta expand map: {default=daemon} 2021-01-27T13:31:17.631 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-27T13:31:17.631 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-27T13:31:17.631 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta expand map: {default=debug} 2021-01-27T13:31:17.632 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-27T13:31:17.632 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 20 expand_channel_meta expanded map: {default=debug} 2021-01-27T13:31:17.632 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:17 smithi037 bash[13442]: debug 2021-01-27T13:31:17.173+0000 7f0369c4e700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2021-01-27T13:31:22.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:17.185209+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-27T13:31:22.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:18.051760+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:22.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: audit 2021-01-27T13:31:18.180691+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: audit 2021-01-27T13:31:19.180890+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:19.182701+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-27T13:31:22.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:20.052230+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:22.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: audit 2021-01-27T13:31:20.180787+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: audit 2021-01-27T13:31:21.181070+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: audit 2021-01-27T13:31:22.181214+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:22.189849+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-27T13:31:22.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:22.203019+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0],c=[v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0]} 2021-01-27T13:31:22.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:22.203146+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-27T13:31:22.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:22.203206+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T13:31:22.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:22.203642+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 69s) 2021-01-27T13:31:22.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[9724]: cluster 2021-01-27T13:31:22.213650+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-27T13:31:22.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:17.185209+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-27T13:31:22.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:18.051760+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:22.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: audit 2021-01-27T13:31:18.180691+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: audit 2021-01-27T13:31:19.180890+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:19.182701+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-27T13:31:22.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:20.052230+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:22.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: audit 2021-01-27T13:31:20.180787+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: audit 2021-01-27T13:31:21.181070+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: audit 2021-01-27T13:31:22.181214+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:22.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:22.189849+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-27T13:31:22.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:22.203019+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0],c=[v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0]} 2021-01-27T13:31:22.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:22.203146+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-27T13:31:22.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:22.203206+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T13:31:22.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:22.203642+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 69s) 2021-01-27T13:31:22.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:22 smithi037 bash[13442]: cluster 2021-01-27T13:31:22.213650+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-27T13:31:23.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2021-01-27T13:31:23.471 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"fsid":"8e2eaa02-60a3-11eb-8f9a-001a4aab830c","modified":"2021-01-27T13:31:17.180747Z","created":"2021-01-27T13:29:08.158447Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3301","nonce":0},{"type":"v1","addr":"172.21.15.37:6790","nonce":0}]},"addr":"172.21.15.37:6790/0","public_addr":"172.21.15.37:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-01-27T13:31:23.473 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 2 2021-01-27T13:31:23.544 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:23 smithi037 bash[13442]: cluster 2021-01-27T13:31:22.052694+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:23.545 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:23 smithi037 bash[13442]: audit 2021-01-27T13:31:23.181282+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:23.545 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:23 smithi037 bash[9724]: cluster 2021-01-27T13:31:22.052694+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:23.545 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:23 smithi037 bash[9724]: audit 2021-01-27T13:31:23.181282+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T13:31:24.338 INFO:tasks.cephadm:Adding mon.b on smithi099 2021-01-27T13:31:24.339 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add mon smithi099:172.21.15.99=b 2021-01-27T13:31:24.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:24 smithi037 bash[9724]: audit 2021-01-27T13:31:23.471385+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.15.37:0/3068797227' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T13:31:24.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:24 smithi037 bash[13442]: audit 2021-01-27T13:31:23.471385+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.15.37:0/3068797227' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T13:31:25.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:25 smithi037 bash[9724]: cluster 2021-01-27T13:31:24.053164+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:25.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:25 smithi037 bash[13442]: cluster 2021-01-27T13:31:24.053164+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:27.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:27 smithi037 bash[9724]: cluster 2021-01-27T13:31:26.053677+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:27.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:27 smithi037 bash[13442]: cluster 2021-01-27T13:31:26.053677+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[9724]: audit 2021-01-27T13:31:27.324588+0000 mgr.y (mgr.14138) 43 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi099:172.21.15.99=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[9724]: audit 2021-01-27T13:31:27.327462+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[9724]: audit 2021-01-27T13:31:27.329804+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:28.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[9724]: cephadm 2021-01-27T13:31:27.331446+0000 mgr.y (mgr.14138) 44 : cephadm [INF] Deploying daemon mon.b on smithi099 2021-01-27T13:31:28.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[9724]: audit 2021-01-27T13:31:27.332511+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T13:31:28.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[13442]: audit 2021-01-27T13:31:27.324588+0000 mgr.y (mgr.14138) 43 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi099:172.21.15.99=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:28.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[13442]: audit 2021-01-27T13:31:27.327462+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:28.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[13442]: audit 2021-01-27T13:31:27.329804+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:28.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[13442]: cephadm 2021-01-27T13:31:27.331446+0000 mgr.y (mgr.14138) 44 : cephadm [INF] Deploying daemon mon.b on smithi099 2021-01-27T13:31:28.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:28 smithi037 bash[13442]: audit 2021-01-27T13:31:27.332511+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T13:31:29.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:29 smithi037 bash[9724]: cluster 2021-01-27T13:31:28.054205+0000 mgr.y (mgr.14138) 45 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:29.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:29 smithi037 bash[13442]: cluster 2021-01-27T13:31:28.054205+0000 mgr.y (mgr.14138) 45 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:31.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:31 smithi037 bash[9724]: cluster 2021-01-27T13:31:30.054699+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:31.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:31 smithi037 bash[13442]: cluster 2021-01-27T13:31:30.054699+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:31.926 INFO:teuthology.orchestra.run.smithi099.stdout:Deployed mon.b on host 'smithi099' 2021-01-27T13:31:32.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:32 smithi037 bash[9724]: cephadm 2021-01-27T13:31:31.915533+0000 mgr.y (mgr.14138) 47 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:31:32.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:32 smithi037 bash[9724]: audit 2021-01-27T13:31:31.916918+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:32.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:32 smithi037 bash[9724]: audit 2021-01-27T13:31:31.922592+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:32.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:32 smithi037 bash[13442]: cephadm 2021-01-27T13:31:31.915533+0000 mgr.y (mgr.14138) 47 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:31:32.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:32 smithi037 bash[13442]: audit 2021-01-27T13:31:31.916918+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:32.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:32 smithi037 bash[13442]: audit 2021-01-27T13:31:31.922592+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:32.975 DEBUG:teuthology.orchestra.run.smithi099:mon.b> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mon.b.service 2021-01-27T13:31:32.978 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-01-27T13:31:32.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph mon dump -f json 2021-01-27T13:31:33.037 INFO:journalctl@ceph.mon.b.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:31:33.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.226+0000 7fe8741bb700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T13:31:33.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.226+0000 7fe8741bb700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-27T13:31:33.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.226+0000 7fe8741bb700 0 pidfile_write: ignore empty --pid-file 2021-01-27T13:31:33.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 0 load: jerasure load: lrc load: isa 2021-01-27T13:31:33.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T13:31:33.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T13:31:33.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T13:31:33.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: DB SUMMARY 2021-01-27T13:31:33.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T13:31:33.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T13:31:33.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-27T13:31:33.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-01-27T13:31:33.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 636 ; 2021-01-27T13:31:33.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T13:31:33.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T13:31:33.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T13:31:33.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.env: 0x55a62995d1c0 2021-01-27T13:31:33.564 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.fs: Posix File System 2021-01-27T13:31:33.564 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.info_log: 0x55a62b55fe80 2021-01-27T13:31:33.564 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T13:31:33.564 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.statistics: (nil) 2021-01-27T13:31:33.565 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.use_fsync: 0 2021-01-27T13:31:33.565 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T13:31:33.565 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T13:31:33.565 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T13:31:33.565 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T13:31:33.566 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T13:31:33.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T13:31:33.567 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T13:31:33.568 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T13:31:33.568 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T13:31:33.568 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T13:31:33.568 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T13:31:33.569 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.db_log_dir: 2021-01-27T13:31:33.569 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-01-27T13:31:33.569 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T13:31:33.569 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T13:31:33.569 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T13:31:33.570 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T13:31:33.570 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T13:31:33.570 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T13:31:33.570 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T13:31:33.570 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T13:31:33.571 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T13:31:33.571 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T13:31:33.571 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.write_buffer_manager: 0x55a62b5b9bf0 2021-01-27T13:31:33.571 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T13:31:33.572 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T13:31:33.572 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T13:31:33.572 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T13:31:33.572 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T13:31:33.572 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T13:31:33.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T13:31:33.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T13:31:33.573 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T13:31:33.574 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.unordered_write: 0 2021-01-27T13:31:33.574 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T13:31:33.574 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T13:31:33.574 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T13:31:33.574 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T13:31:33.575 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.row_cache: None 2021-01-27T13:31:33.575 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.wal_filter: None 2021-01-27T13:31:33.575 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T13:31:33.575 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T13:31:33.575 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T13:31:33.576 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T13:31:33.576 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T13:31:33.576 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T13:31:33.576 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T13:31:33.576 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T13:31:33.577 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T13:31:33.577 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T13:31:33.577 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T13:31:33.577 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T13:31:33.577 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T13:31:33.578 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T13:31:33.578 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T13:31:33.578 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T13:31:33.578 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T13:31:33.578 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T13:31:33.579 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T13:31:33.579 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T13:31:33.579 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T13:31:33.579 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_open_files: -1 2021-01-27T13:31:33.579 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T13:31:33.580 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T13:31:33.580 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T13:31:33.580 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T13:31:33.580 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Compression algorithms supported: 2021-01-27T13:31:33.580 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T13:31:33.581 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: kZSTD supported: 0 2021-01-27T13:31:33.581 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T13:31:33.581 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T13:31:33.581 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T13:31:33.582 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T13:31:33.582 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T13:31:33.582 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T13:31:33.582 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T13:31:33.583 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2021-01-27T13:31:33.583 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T13:31:33.583 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T13:31:33.583 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.merge_operator: 2021-01-27T13:31:33.583 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_filter: None 2021-01-27T13:31:33.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T13:31:33.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T13:31:33.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T13:31:33.584 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a62b5081e0) 2021-01-27T13:31:33.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: cache_index_and_filter_blocks: 1 2021-01-27T13:31:33.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T13:31:33.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T13:31:33.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: pin_top_level_index_and_filter: 1 2021-01-27T13:31:33.585 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: index_type: 0 2021-01-27T13:31:33.586 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: data_block_index_type: 0 2021-01-27T13:31:33.586 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: index_shortening: 1 2021-01-27T13:31:33.586 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T13:31:33.586 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: hash_index_allow_collision: 1 2021-01-27T13:31:33.586 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: checksum: 1 2021-01-27T13:31:33.587 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: no_block_cache: 0 2021-01-27T13:31:33.587 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: block_cache: 0x55a62b540510 2021-01-27T13:31:33.587 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: block_cache_name: BinnedLRUCache 2021-01-27T13:31:33.587 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: block_cache_options: 2021-01-27T13:31:33.587 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: capacity : 536870912 2021-01-27T13:31:33.588 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: num_shard_bits : 4 2021-01-27T13:31:33.588 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: strict_capacity_limit : 0 2021-01-27T13:31:33.588 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: high_pri_pool_ratio: 0.000 2021-01-27T13:31:33.588 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: block_cache_compressed: (nil) 2021-01-27T13:31:33.588 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: persistent_cache: (nil) 2021-01-27T13:31:33.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: block_size: 4096 2021-01-27T13:31:33.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: block_size_deviation: 10 2021-01-27T13:31:33.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: block_restart_interval: 16 2021-01-27T13:31:33.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: index_block_restart_interval: 1 2021-01-27T13:31:33.589 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: metadata_block_size: 4096 2021-01-27T13:31:33.590 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: partition_filters: 0 2021-01-27T13:31:33.590 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: use_delta_encoding: 1 2021-01-27T13:31:33.590 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T13:31:33.590 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: whole_key_filtering: 1 2021-01-27T13:31:33.590 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: verify_compression: 0 2021-01-27T13:31:33.591 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: read_amp_bytes_per_bit: 0 2021-01-27T13:31:33.591 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: format_version: 2 2021-01-27T13:31:33.591 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: enable_index_compression: 1 2021-01-27T13:31:33.591 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: block_align: 0 2021-01-27T13:31:33.591 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T13:31:33.592 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T13:31:33.592 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compression: NoCompression 2021-01-27T13:31:33.592 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T13:31:33.592 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T13:31:33.592 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T13:31:33.593 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.num_levels: 7 2021-01-27T13:31:33.593 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T13:31:33.593 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T13:31:33.593 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T13:31:33.593 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T13:31:33.594 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T13:31:33.594 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T13:31:33.594 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T13:31:33.594 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T13:31:33.594 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T13:31:33.595 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T13:31:33.595 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T13:31:33.595 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T13:31:33.595 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T13:31:33.595 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T13:31:33.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T13:31:33.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T13:31:33.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T13:31:33.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T13:31:33.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T13:31:33.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T13:31:33.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T13:31:33.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T13:31:33.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T13:31:33.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T13:31:33.598 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T13:31:33.598 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T13:31:33.598 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T13:31:33.598 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T13:31:33.599 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T13:31:33.599 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T13:31:33.599 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T13:31:33.599 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T13:31:33.599 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T13:31:33.600 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T13:31:33.600 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T13:31:33.600 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T13:31:33.600 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T13:31:33.600 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T13:31:33.601 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T13:31:33.601 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T13:31:33.601 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T13:31:33.601 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T13:31:33.601 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T13:31:33.602 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T13:31:33.602 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T13:31:33.602 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T13:31:33.602 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T13:31:33.602 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T13:31:33.603 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T13:31:33.603 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T13:31:33.603 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T13:31:33.603 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T13:31:33.604 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T13:31:33.604 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T13:31:33.604 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T13:31:33.604 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T13:31:33.604 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T13:31:33.605 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T13:31:33.605 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T13:31:33.605 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.ttl: 2592000 2021-01-27T13:31:33.605 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.230+0000 7fe8741bb700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T13:31:33.605 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.234+0000 7fe8741bb700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T13:31:33.606 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.234+0000 7fe8741bb700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T13:31:33.606 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.234+0000 7fe8741bb700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754293236927, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-27T13:31:33.606 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.234+0000 7fe8741bb700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-27T13:31:33.606 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.234+0000 7fe8741bb700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T13:31:33.606 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.234+0000 7fe8741bb700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754293237692, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1562, "table_properties": {"data_size": 648, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611754293, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T13:31:33.607 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.234+0000 7fe8741bb700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-27T13:31:33.607 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.238+0000 7fe8741bb700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611754293239732, "job": 1, "event": "recovery_finished"} 2021-01-27T13:31:33.607 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.238+0000 7fe8741bb700 4 rocksdb: DB pointer 0x55a62b5ff800 2021-01-27T13:31:33.607 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.238+0000 7fe85afdc700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T13:31:33.607 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.238+0000 7fe85afdc700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T13:31:33.608 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ** DB Stats ** 2021-01-27T13:31:33.608 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:31:33.608 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T13:31:33.608 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T13:31:33.609 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T13:31:33.609 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T13:31:33.609 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T13:31:33.609 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T13:31:33.609 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ** Compaction Stats [default] ** 2021-01-27T13:31:33.610 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:31:33.610 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:31:33.610 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:33.610 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:33.610 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:33.611 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ** Compaction Stats [default] ** 2021-01-27T13:31:33.611 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:31:33.611 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:31:33.611 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:33.611 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:31:33.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T13:31:33.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T13:31:33.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T13:31:33.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T13:31:33.612 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T13:31:33.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:31:33.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:31:33.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T13:31:33.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T13:31:33.613 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ** Compaction Stats [default] ** 2021-01-27T13:31:33.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:31:33.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:31:33.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:33.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:33.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T13:31:33.615 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ** Compaction Stats [default] ** 2021-01-27T13:31:33.615 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T13:31:33.615 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T13:31:33.615 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 0.00 0.00 1 0.001 0 0 2021-01-27T13:31:33.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T13:31:33.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T13:31:33.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T13:31:33.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T13:31:33.616 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T13:31:33.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T13:31:33.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:31:33.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T13:31:33.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T13:31:33.617 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T13:31:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.238+0000 7fe8741bb700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2021-01-27T13:31:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.238+0000 7fe8741bb700 0 using public_addr v2:172.21.15.99:0/0 -> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2021-01-27T13:31:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.238+0000 7fe8741bb700 0 starting mon.b rank -1 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:31:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.242+0000 7fe8741bb700 1 mon.b@-1(???) e0 preinit fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:31:33.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 0 mon.b@-1(synchronizing).mds e1 new map 2021-01-27T13:31:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-01-27T13:31:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: e1 2021-01-27T13:31:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T13:31:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T13:31:33.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: legacy client fscid: -1 2021-01-27T13:31:33.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: 2021-01-27T13:31:33.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: No filesystems configured 2021-01-27T13:31:33.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-27T13:31:33.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-27T13:31:33.620 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-27T13:31:33.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-27T13:31:33.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-27T13:31:33.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-27T13:31:33.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-27T13:31:33.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-27T13:31:33.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-27T13:31:33.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T13:31:33.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T13:31:33.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.274+0000 7fe85d7e1700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T13:31:33.622 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: cephadm 2021-01-27T13:31:31.915533+0000 mgr.y (mgr.14138) 47 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:31:33.623 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: audit 2021-01-27T13:31:31.916918+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:33.623 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: audit 2021-01-27T13:31:31.922592+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:33.623 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:33 smithi099 bash[9889]: debug 2021-01-27T13:31:33.278+0000 7fe85d7e1700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-01-27T13:31:38.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:33.292026+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-27T13:31:38.735 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:33.294244+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-27T13:31:38.735 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:34.055529+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:38.735 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:34.284276+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:35.284497+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:35.288329+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T13:31:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:36.055992+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:36.284567+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:37.284603+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:38.284795+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:38.299264+0000 mon.a (mon.0) 174 : cluster [INF] mon.a calling monitor election 2021-01-27T13:31:38.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:38.317981+0000 mon.a (mon.0) 175 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T13:31:38.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:38.328365+0000 mon.a (mon.0) 176 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0]} 2021-01-27T13:31:38.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:38.328545+0000 mon.a (mon.0) 177 : cluster [DBG] fsmap 2021-01-27T13:31:38.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:38.328648+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T13:31:38.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:38.329333+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e13: y(active, since 85s) 2021-01-27T13:31:38.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: cluster 2021-01-27T13:31:38.335910+0000 mon.a (mon.0) 180 : cluster [INF] overall HEALTH_OK 2021-01-27T13:31:38.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:38.341317+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:38.739 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:38.342638+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T13:31:38.739 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:38.343708+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:38.739 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[9724]: audit 2021-01-27T13:31:38.345351+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T13:31:38.739 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:33.292026+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-27T13:31:38.739 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:33.294244+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-27T13:31:38.740 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:34.055529+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:38.740 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:34.284276+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.740 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:35.284497+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.741 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:35.288329+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T13:31:38.741 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:36.055992+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:38.741 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:36.284567+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.741 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:37.284603+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.742 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:38.284795+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.742 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:38.299264+0000 mon.a (mon.0) 174 : cluster [INF] mon.a calling monitor election 2021-01-27T13:31:38.742 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:38.317981+0000 mon.a (mon.0) 175 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T13:31:38.743 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:38.328365+0000 mon.a (mon.0) 176 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0]} 2021-01-27T13:31:38.743 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:38.328545+0000 mon.a (mon.0) 177 : cluster [DBG] fsmap 2021-01-27T13:31:38.743 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:38.328648+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T13:31:38.743 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:38.329333+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e13: y(active, since 85s) 2021-01-27T13:31:38.743 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: cluster 2021-01-27T13:31:38.335910+0000 mon.a (mon.0) 180 : cluster [INF] overall HEALTH_OK 2021-01-27T13:31:38.744 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:38.341317+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:38.744 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:38.342638+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T13:31:38.744 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:38.343708+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:38.744 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:38 smithi037 bash[13442]: audit 2021-01-27T13:31:38.345351+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T13:31:38.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:33.292026+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-27T13:31:38.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:33.294244+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-27T13:31:38.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:34.055529+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:38.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:34.284276+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:35.284497+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:35.288329+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T13:31:38.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:36.055992+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:36.284567+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:37.284603+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:38.284795+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:38.299264+0000 mon.a (mon.0) 174 : cluster [INF] mon.a calling monitor election 2021-01-27T13:31:38.813 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:38.317981+0000 mon.a (mon.0) 175 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T13:31:38.813 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:38.328365+0000 mon.a (mon.0) 176 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0],b=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0]} 2021-01-27T13:31:38.813 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:38.328545+0000 mon.a (mon.0) 177 : cluster [DBG] fsmap 2021-01-27T13:31:38.814 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:38.328648+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T13:31:38.814 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:38.329333+0000 mon.a (mon.0) 179 : cluster [DBG] mgrmap e13: y(active, since 85s) 2021-01-27T13:31:38.814 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: cluster 2021-01-27T13:31:38.335910+0000 mon.a (mon.0) 180 : cluster [INF] overall HEALTH_OK 2021-01-27T13:31:38.814 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:38.341317+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:38.814 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:38.342638+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T13:31:38.815 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:38.343708+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:38.815 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:38 smithi099 bash[9889]: audit 2021-01-27T13:31:38.345351+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T13:31:39.169 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-01-27T13:31:39.169 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":3,"fsid":"8e2eaa02-60a3-11eb-8f9a-001a4aab830c","modified":"2021-01-27T13:31:33.285438Z","created":"2021-01-27T13:29:08.158447Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3301","nonce":0},{"type":"v1","addr":"172.21.15.37:6790","nonce":0}]},"addr":"172.21.15.37:6790/0","public_addr":"172.21.15.37:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2021-01-27T13:31:39.177 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 3 2021-01-27T13:31:39.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:39 smithi099 bash[9889]: cluster 2021-01-27T13:31:38.056437+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:39.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:39 smithi099 bash[9889]: cephadm 2021-01-27T13:31:38.342232+0000 mgr.y (mgr.14138) 54 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-27T13:31:39.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:39 smithi099 bash[9889]: cephadm 2021-01-27T13:31:38.344659+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring daemon mgr.y on smithi037 2021-01-27T13:31:39.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:39 smithi099 bash[9889]: audit 2021-01-27T13:31:39.170249+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.99:0/2375867494' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T13:31:39.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:39 smithi099 bash[9889]: audit 2021-01-27T13:31:39.285071+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:39.733 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[13442]: cluster 2021-01-27T13:31:38.056437+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:39.733 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[13442]: cephadm 2021-01-27T13:31:38.342232+0000 mgr.y (mgr.14138) 54 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-27T13:31:39.733 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[13442]: cephadm 2021-01-27T13:31:38.344659+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring daemon mgr.y on smithi037 2021-01-27T13:31:39.733 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[13442]: audit 2021-01-27T13:31:39.170249+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.99:0/2375867494' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T13:31:39.734 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[13442]: audit 2021-01-27T13:31:39.285071+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:39.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[9724]: cluster 2021-01-27T13:31:38.056437+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:39.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[9724]: cephadm 2021-01-27T13:31:38.342232+0000 mgr.y (mgr.14138) 54 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-27T13:31:39.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[9724]: cephadm 2021-01-27T13:31:38.344659+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring daemon mgr.y on smithi037 2021-01-27T13:31:39.735 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[9724]: audit 2021-01-27T13:31:39.170249+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.99:0/2375867494' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T13:31:39.735 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:39 smithi037 bash[9724]: audit 2021-01-27T13:31:39.285071+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T13:31:39.847 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-01-27T13:31:39.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph config generate-minimal-conf 2021-01-27T13:31:41.684 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[9724]: cluster 2021-01-27T13:31:40.056930+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:41.685 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[9724]: audit 2021-01-27T13:31:41.066494+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:41.685 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[9724]: audit 2021-01-27T13:31:41.067759+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:41.685 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[9724]: audit 2021-01-27T13:31:41.069253+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:41.686 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[9724]: audit 2021-01-27T13:31:41.071253+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T13:31:41.686 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[13442]: cluster 2021-01-27T13:31:40.056930+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:41.686 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[13442]: audit 2021-01-27T13:31:41.066494+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:41.686 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[13442]: audit 2021-01-27T13:31:41.067759+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:41.687 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[13442]: audit 2021-01-27T13:31:41.069253+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:41.687 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:41 smithi037 bash[13442]: audit 2021-01-27T13:31:41.071253+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T13:31:41.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:41 smithi099 bash[9889]: cluster 2021-01-27T13:31:40.056930+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:41.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:41 smithi099 bash[9889]: audit 2021-01-27T13:31:41.066494+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:41.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:41 smithi099 bash[9889]: audit 2021-01-27T13:31:41.067759+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:41.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:41 smithi099 bash[9889]: audit 2021-01-27T13:31:41.069253+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:41.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:41 smithi099 bash[9889]: audit 2021-01-27T13:31:41.071253+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T13:31:42.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:42 smithi099 bash[9889]: cephadm 2021-01-27T13:31:41.067240+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T13:31:42.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:42 smithi099 bash[9889]: cephadm 2021-01-27T13:31:41.070502+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi037 2021-01-27T13:31:42.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:42 smithi037 bash[9724]: cephadm 2021-01-27T13:31:41.067240+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T13:31:42.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:42 smithi037 bash[9724]: cephadm 2021-01-27T13:31:41.070502+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi037 2021-01-27T13:31:42.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:42 smithi037 bash[13442]: cephadm 2021-01-27T13:31:41.067240+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T13:31:42.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:42 smithi037 bash[13442]: cephadm 2021-01-27T13:31:41.070502+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi037 2021-01-27T13:31:43.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:43 smithi037 bash[9724]: cluster 2021-01-27T13:31:42.057396+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:43.678 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:43 smithi037 bash[13442]: cluster 2021-01-27T13:31:42.057396+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:43.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:43 smithi099 bash[9889]: cluster 2021-01-27T13:31:42.057396+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:45.200 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:31:45.201 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2021-01-27T13:31:45.201 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 8e2eaa02-60a3-11eb-8f9a-001a4aab830c 2021-01-27T13:31:45.201 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2021-01-27T13:31:45.974 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-01-27T13:31:45.974 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:31:45.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2021-01-27T13:31:45.990 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:31:45.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T13:31:46.004 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:31:46.004 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2021-01-27T13:31:46.022 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:31:46.022 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T13:31:46.079 INFO:tasks.cephadm:Adding mgr.y on smithi037 2021-01-27T13:31:46.080 INFO:tasks.cephadm:Adding mgr.x on smithi099 2021-01-27T13:31:46.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch apply mgr '3;smithi037=y;smithi099=x' 2021-01-27T13:31:46.198 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:45 smithi099 bash[9889]: cluster 2021-01-27T13:31:44.057924+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:46.199 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:45 smithi099 bash[9889]: audit 2021-01-27T13:31:44.946833+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:46.199 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:45 smithi099 bash[9889]: cephadm 2021-01-27T13:31:44.947766+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T13:31:46.199 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:45 smithi099 bash[9889]: audit 2021-01-27T13:31:44.948330+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:46.199 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:45 smithi099 bash[9889]: audit 2021-01-27T13:31:44.949739+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:46.199 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:45 smithi099 bash[9889]: cephadm 2021-01-27T13:31:44.950784+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring daemon mon.b on smithi099 2021-01-27T13:31:46.200 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:45 smithi099 bash[9889]: audit 2021-01-27T13:31:44.951580+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T13:31:46.200 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:45 smithi099 bash[9889]: audit 2021-01-27T13:31:45.202328+0000 mon.a (mon.0) 195 : audit [DBG] from='client.? 172.21.15.37:0/1471236349' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:46.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[9724]: cluster 2021-01-27T13:31:44.057924+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:46.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[9724]: audit 2021-01-27T13:31:44.946833+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:46.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[9724]: cephadm 2021-01-27T13:31:44.947766+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T13:31:46.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[9724]: audit 2021-01-27T13:31:44.948330+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:46.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[9724]: audit 2021-01-27T13:31:44.949739+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:46.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[9724]: cephadm 2021-01-27T13:31:44.950784+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring daemon mon.b on smithi099 2021-01-27T13:31:46.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[9724]: audit 2021-01-27T13:31:44.951580+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T13:31:46.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[9724]: audit 2021-01-27T13:31:45.202328+0000 mon.a (mon.0) 195 : audit [DBG] from='client.? 172.21.15.37:0/1471236349' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[13442]: cluster 2021-01-27T13:31:44.057924+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[13442]: audit 2021-01-27T13:31:44.946833+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[13442]: cephadm 2021-01-27T13:31:44.947766+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T13:31:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[13442]: audit 2021-01-27T13:31:44.948330+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[13442]: audit 2021-01-27T13:31:44.949739+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:46.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[13442]: cephadm 2021-01-27T13:31:44.950784+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring daemon mon.b on smithi099 2021-01-27T13:31:46.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[13442]: audit 2021-01-27T13:31:44.951580+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T13:31:46.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:45 smithi037 bash[13442]: audit 2021-01-27T13:31:45.202328+0000 mon.a (mon.0) 195 : audit [DBG] from='client.? 172.21.15.37:0/1471236349' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:48.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:47 smithi099 bash[9889]: cluster 2021-01-27T13:31:46.058426+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:48.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:47 smithi099 bash[9889]: audit 2021-01-27T13:31:47.394533+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:48.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:47 smithi099 bash[9889]: audit 2021-01-27T13:31:47.397092+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:48.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:47 smithi099 bash[9889]: audit 2021-01-27T13:31:47.397841+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:48.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:47 smithi037 bash[13442]: cluster 2021-01-27T13:31:46.058426+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:48.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:47 smithi037 bash[13442]: audit 2021-01-27T13:31:47.394533+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:48.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:47 smithi037 bash[13442]: audit 2021-01-27T13:31:47.397092+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:48.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:47 smithi037 bash[13442]: audit 2021-01-27T13:31:47.397841+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:47 smithi037 bash[9724]: cluster 2021-01-27T13:31:46.058426+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:47 smithi037 bash[9724]: audit 2021-01-27T13:31:47.394533+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:47 smithi037 bash[9724]: audit 2021-01-27T13:31:47.397092+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:48.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:47 smithi037 bash[9724]: audit 2021-01-27T13:31:47.397841+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:49.516 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled mgr update... 2021-01-27T13:31:49.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: cluster 2021-01-27T13:31:48.058842+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:49.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: audit 2021-01-27T13:31:48.191031+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: audit 2021-01-27T13:31:48.238698+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: audit 2021-01-27T13:31:48.247705+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: cephadm 2021-01-27T13:31:48.248712+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T13:31:49.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: audit 2021-01-27T13:31:48.249314+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:49.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: audit 2021-01-27T13:31:48.251088+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:49.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: cephadm 2021-01-27T13:31:48.252515+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring daemon mon.a on smithi037 2021-01-27T13:31:49.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:49 smithi099 bash[9889]: audit 2021-01-27T13:31:48.253870+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T13:31:49.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: cluster 2021-01-27T13:31:48.058842+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:49.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: audit 2021-01-27T13:31:48.191031+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: audit 2021-01-27T13:31:48.238698+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: audit 2021-01-27T13:31:48.247705+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: cephadm 2021-01-27T13:31:48.248712+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T13:31:49.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: audit 2021-01-27T13:31:48.249314+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:49.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: audit 2021-01-27T13:31:48.251088+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:49.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: cephadm 2021-01-27T13:31:48.252515+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring daemon mon.a on smithi037 2021-01-27T13:31:49.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[9724]: audit 2021-01-27T13:31:48.253870+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T13:31:49.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: cluster 2021-01-27T13:31:48.058842+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:49.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: audit 2021-01-27T13:31:48.191031+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: audit 2021-01-27T13:31:48.238698+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: audit 2021-01-27T13:31:48.247705+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:49.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: cephadm 2021-01-27T13:31:48.248712+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T13:31:49.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: audit 2021-01-27T13:31:48.249314+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T13:31:49.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: audit 2021-01-27T13:31:48.251088+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:49.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: cephadm 2021-01-27T13:31:48.252515+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring daemon mon.a on smithi037 2021-01-27T13:31:49.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:49 smithi037 bash[13442]: audit 2021-01-27T13:31:48.253870+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T13:31:50.143 DEBUG:teuthology.orchestra.run.smithi099:mgr.x> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@mgr.x.service 2021-01-27T13:31:50.147 INFO:tasks.cephadm:Deploying OSDs... 2021-01-27T13:31:50.147 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:31:50.148 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2021-01-27T13:31:50.156 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-27T13:31:50.156 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-27T13:31:50.202 INFO:journalctl@ceph.mgr.x.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:31:50.205 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-27T13:31:50.205 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T13:31:50.206 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-01-27T13:31:50.206 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T13:31:50.206 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2021-01-27 13:25:59.151440634 +0000 2021-01-27T13:31:50.206 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2021-01-27 13:25:59.147440634 +0000 2021-01-27T13:31:50.207 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2021-01-27 13:25:59.147440634 +0000 2021-01-27T13:31:50.207 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2021-01-27T13:31:50.217 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2021-01-27T13:31:50.217 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2021-01-27T13:31:50.218 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000400304 s, 1.3 MB/s 2021-01-27T13:31:50.221 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-27T13:31:50.227 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-27T13:31:50.228 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T13:31:50.228 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-01-27T13:31:50.228 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T13:31:50.229 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2021-01-27 13:25:59.699440622 +0000 2021-01-27T13:31:50.229 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2021-01-27 13:25:59.523440626 +0000 2021-01-27T13:31:50.229 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2021-01-27 13:25:59.523440626 +0000 2021-01-27T13:31:50.229 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2021-01-27T13:31:50.237 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2021-01-27T13:31:50.237 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2021-01-27T13:31:50.237 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.00028198 s, 1.8 MB/s 2021-01-27T13:31:50.241 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-27T13:31:50.248 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-27T13:31:50.249 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T13:31:50.249 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 361 Links: 1 2021-01-27T13:31:50.249 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T13:31:50.249 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2021-01-27 13:25:59.963440616 +0000 2021-01-27T13:31:50.250 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2021-01-27 13:25:59.959440616 +0000 2021-01-27T13:31:50.250 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2021-01-27 13:25:59.959440616 +0000 2021-01-27T13:31:50.250 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2021-01-27T13:31:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2021-01-27T13:31:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2021-01-27T13:31:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000392307 s, 1.3 MB/s 2021-01-27T13:31:50.262 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-27T13:31:50.270 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-27T13:31:50.270 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T13:31:50.270 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-01-27T13:31:50.270 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T13:31:50.271 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2021-01-27 13:26:00.539440603 +0000 2021-01-27T13:31:50.271 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2021-01-27 13:26:00.387440607 +0000 2021-01-27T13:31:50.271 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2021-01-27 13:26:00.387440607 +0000 2021-01-27T13:31:50.271 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2021-01-27T13:31:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2021-01-27T13:31:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2021-01-27T13:31:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000417097 s, 1.2 MB/s 2021-01-27T13:31:50.283 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:31:50.283 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2021-01-27T13:31:50.291 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-27T13:31:50.291 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-27T13:31:50.298 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-27T13:31:50.299 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T13:31:50.299 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 349 Links: 1 2021-01-27T13:31:50.299 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T13:31:50.300 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2021-01-27 13:25:59.763199309 +0000 2021-01-27T13:31:50.300 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2021-01-27 13:25:59.759199309 +0000 2021-01-27T13:31:50.300 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2021-01-27 13:25:59.759199309 +0000 2021-01-27T13:31:50.300 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2021-01-27T13:31:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2021-01-27T13:31:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2021-01-27T13:31:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000416907 s, 1.2 MB/s 2021-01-27T13:31:50.314 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-27T13:31:50.320 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-27T13:31:50.320 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T13:31:50.321 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 356 Links: 1 2021-01-27T13:31:50.321 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T13:31:50.321 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2021-01-27 13:26:00.311199303 +0000 2021-01-27T13:31:50.321 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2021-01-27 13:26:00.139199305 +0000 2021-01-27T13:31:50.322 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2021-01-27 13:26:00.139199305 +0000 2021-01-27T13:31:50.322 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2021-01-27T13:31:50.326 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2021-01-27T13:31:50.326 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2021-01-27T13:31:50.327 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000358887 s, 1.4 MB/s 2021-01-27T13:31:50.330 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-27T13:31:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-27T13:31:50.382 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T13:31:50.382 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 363 Links: 1 2021-01-27T13:31:50.383 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T13:31:50.383 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2021-01-27 13:26:00.547199300 +0000 2021-01-27T13:31:50.383 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2021-01-27 13:26:00.543199300 +0000 2021-01-27T13:31:50.383 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2021-01-27 13:26:00.543199300 +0000 2021-01-27T13:31:50.384 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2021-01-27T13:31:50.392 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2021-01-27T13:31:50.393 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2021-01-27T13:31:50.393 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000396953 s, 1.3 MB/s 2021-01-27T13:31:50.397 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-27T13:31:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-27T13:31:50.404 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T13:31:50.405 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 367 Links: 1 2021-01-27T13:31:50.405 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T13:31:50.405 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2021-01-27 13:26:00.939199296 +0000 2021-01-27T13:31:50.406 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2021-01-27 13:26:00.935199296 +0000 2021-01-27T13:31:50.406 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2021-01-27 13:26:00.935199296 +0000 2021-01-27T13:31:50.407 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2021-01-27T13:31:50.413 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2021-01-27T13:31:50.413 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2021-01-27T13:31:50.413 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000313562 s, 1.6 MB/s 2021-01-27T13:31:50.419 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2021-01-27T13:31:50.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-27T13:31:50.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:50 smithi099 bash[9889]: audit 2021-01-27T13:31:49.508597+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=y;smithi099=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:50.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:50 smithi099 bash[9889]: cephadm 2021-01-27T13:31:49.510688+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi037=y;smithi099=x;count:3 2021-01-27T13:31:50.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:50 smithi099 bash[9889]: audit 2021-01-27T13:31:49.516945+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:50.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:50 smithi037 bash[9724]: audit 2021-01-27T13:31:49.508597+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=y;smithi099=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:50.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:50 smithi037 bash[9724]: cephadm 2021-01-27T13:31:49.510688+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi037=y;smithi099=x;count:3 2021-01-27T13:31:50.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:50 smithi037 bash[9724]: audit 2021-01-27T13:31:49.516945+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:50.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:50 smithi037 bash[13442]: audit 2021-01-27T13:31:49.508597+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=y;smithi099=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:50.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:50 smithi037 bash[13442]: cephadm 2021-01-27T13:31:49.510688+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi037=y;smithi099=x;count:3 2021-01-27T13:31:50.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:50 smithi037 bash[13442]: audit 2021-01-27T13:31:49.516945+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:51.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: cluster 2021-01-27T13:31:50.059302+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:51.942 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:50.620311+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:51.942 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:50.621894+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:51.942 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:51.423635+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:51.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:51.428949+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:51.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:51.430678+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T13:31:51.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:51.435216+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T13:31:51.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:51.436711+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T13:31:51.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:51.438106+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:51.944 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[9724]: audit 2021-01-27T13:31:51.439581+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T13:31:51.944 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: cluster 2021-01-27T13:31:50.059302+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:51.944 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:50.620311+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:51.944 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:50.621894+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:51.945 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:51.423635+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:51.945 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:51.428949+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:51.945 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:51.430678+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T13:31:51.945 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:51.435216+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T13:31:51.946 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:51.436711+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T13:31:51.946 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:51.438106+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:51.946 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:51 smithi037 bash[13442]: audit 2021-01-27T13:31:51.439581+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T13:31:52.059 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: cluster 2021-01-27T13:31:50.059302+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:52.059 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:50.620311+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:52.060 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:50.621894+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:52.060 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:51.423635+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:52.060 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:51.428949+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:52.060 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:51.430678+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T13:31:52.060 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:51.435216+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T13:31:52.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:51.436711+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T13:31:52.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:51.438106+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:52.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:51 smithi099 bash[9889]: audit 2021-01-27T13:31:51.439581+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T13:31:52.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:52 smithi037 bash[9724]: cephadm 2021-01-27T13:31:51.429949+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='x')] 2021-01-27T13:31:52.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:52 smithi037 bash[9724]: cephadm 2021-01-27T13:31:51.438987+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Deploying daemon mgr.x on smithi099 2021-01-27T13:31:52.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:52 smithi037 bash[13442]: cephadm 2021-01-27T13:31:51.429949+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='x')] 2021-01-27T13:31:52.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:52 smithi037 bash[13442]: cephadm 2021-01-27T13:31:51.438987+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Deploying daemon mgr.x on smithi099 2021-01-27T13:31:52.964 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:52 smithi099 bash[9889]: cephadm 2021-01-27T13:31:51.429949+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='x')] 2021-01-27T13:31:52.965 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:52 smithi099 bash[9889]: cephadm 2021-01-27T13:31:51.438987+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Deploying daemon mgr.x on smithi099 2021-01-27T13:31:53.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:53 smithi099 bash[9889]: cluster 2021-01-27T13:31:52.059778+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:53.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:53 smithi037 bash[9724]: cluster 2021-01-27T13:31:52.059778+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:53.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:53 smithi037 bash[13442]: cluster 2021-01-27T13:31:52.059778+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-27T13:31:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-27T13:31:54.023 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2021-01-27T13:31:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2021-01-27T13:31:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0148858 s, 704 MB/s 2021-01-27T13:31:54.024 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2021-01-27T13:31:54.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2021-01-27T13:31:55.309 INFO:journalctl@ceph.mgr.x.smithi099.stdout:Jan 27 13:31:55 smithi099 bash[10602]: debug 2021-01-27T13:31:55.030+0000 7f36274df700 1 -- 172.21.15.99:0/2522018334 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561c0c8c24e0 con 0x561c0c9aec00 2021-01-27T13:31:55.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:55 smithi099 bash[9889]: audit 2021-01-27T13:31:54.029883+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:55.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:55 smithi099 bash[9889]: audit 2021-01-27T13:31:54.031946+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:55.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:55 smithi099 bash[9889]: audit 2021-01-27T13:31:54.032318+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:55.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:55 smithi099 bash[9889]: audit 2021-01-27T13:31:54.884789+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:55.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:55 smithi037 bash[9724]: audit 2021-01-27T13:31:54.029883+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:55.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:55 smithi037 bash[9724]: audit 2021-01-27T13:31:54.031946+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:55.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:55 smithi037 bash[9724]: audit 2021-01-27T13:31:54.032318+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:55.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:55 smithi037 bash[9724]: audit 2021-01-27T13:31:54.884789+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:55.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:55 smithi037 bash[13442]: audit 2021-01-27T13:31:54.029883+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:55.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:55 smithi037 bash[13442]: audit 2021-01-27T13:31:54.031946+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:55.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:55 smithi037 bash[13442]: audit 2021-01-27T13:31:54.032318+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:55.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:55 smithi037 bash[13442]: audit 2021-01-27T13:31:54.884789+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[9724]: cluster 2021-01-27T13:31:54.060095+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:56.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[9724]: audit 2021-01-27T13:31:55.108367+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[9724]: audit 2021-01-27T13:31:55.115573+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[9724]: audit 2021-01-27T13:31:55.118343+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:56.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[9724]: audit 2021-01-27T13:31:55.950186+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.309 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[9724]: audit 2021-01-27T13:31:55.956232+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.309 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[13442]: cluster 2021-01-27T13:31:54.060095+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:56.309 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[13442]: audit 2021-01-27T13:31:55.108367+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.309 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[13442]: audit 2021-01-27T13:31:55.115573+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.309 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[13442]: audit 2021-01-27T13:31:55.118343+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:56.310 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[13442]: audit 2021-01-27T13:31:55.950186+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.310 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:56 smithi037 bash[13442]: audit 2021-01-27T13:31:55.956232+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:56 smithi099 bash[9889]: cluster 2021-01-27T13:31:54.060095+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:56.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:56 smithi099 bash[9889]: audit 2021-01-27T13:31:55.108367+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:56 smithi099 bash[9889]: audit 2021-01-27T13:31:55.115573+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:56 smithi099 bash[9889]: audit 2021-01-27T13:31:55.118343+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:31:56.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:56 smithi099 bash[9889]: audit 2021-01-27T13:31:55.950186+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:56.316 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:56 smithi099 bash[9889]: audit 2021-01-27T13:31:55.956232+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:31:57.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:57 smithi099 bash[9889]: cephadm 2021-01-27T13:31:55.116630+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:31:57.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:57 smithi099 bash[9889]: cephadm 2021-01-27T13:31:55.957515+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:31:57.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:57 smithi037 bash[9724]: cephadm 2021-01-27T13:31:55.116630+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:31:57.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:57 smithi037 bash[9724]: cephadm 2021-01-27T13:31:55.957515+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:31:57.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:57 smithi037 bash[13442]: cephadm 2021-01-27T13:31:55.116630+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:31:57.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:57 smithi037 bash[13442]: cephadm 2021-01-27T13:31:55.957515+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:31:58.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:58 smithi099 bash[9889]: cluster 2021-01-27T13:31:56.060485+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:58.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:58 smithi037 bash[9724]: cluster 2021-01-27T13:31:56.060485+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:58.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:58 smithi037 bash[13442]: cluster 2021-01-27T13:31:56.060485+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:59.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[9724]: cluster 2021-01-27T13:31:58.060845+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:59.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[9724]: audit 2021-01-27T13:31:58.254290+0000 mgr.y (mgr.14138) 78 : audit [DBG] from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:59.068 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[9724]: audit 2021-01-27T13:31:58.256156+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:31:59.068 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[9724]: cephadm 2021-01-27T13:31:58.259218+0000 mgr.y (mgr.14138) 79 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:31:59.068 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[9724]: audit 2021-01-27T13:31:58.259685+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:31:59.068 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[9724]: audit 2021-01-27T13:31:58.261007+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:59.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[9724]: audit 2021-01-27T13:31:58.262710+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:31:59.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[13442]: cluster 2021-01-27T13:31:58.060845+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:59.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[13442]: audit 2021-01-27T13:31:58.254290+0000 mgr.y (mgr.14138) 78 : audit [DBG] from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:59.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[13442]: audit 2021-01-27T13:31:58.256156+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:31:59.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[13442]: cephadm 2021-01-27T13:31:58.259218+0000 mgr.y (mgr.14138) 79 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:31:59.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[13442]: audit 2021-01-27T13:31:58.259685+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:31:59.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[13442]: audit 2021-01-27T13:31:58.261007+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:59.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:31:59 smithi037 bash[13442]: audit 2021-01-27T13:31:58.262710+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:31:59.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:59 smithi099 bash[9889]: cluster 2021-01-27T13:31:58.060845+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:31:59.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:59 smithi099 bash[9889]: audit 2021-01-27T13:31:58.254290+0000 mgr.y (mgr.14138) 78 : audit [DBG] from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:31:59.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:59 smithi099 bash[9889]: audit 2021-01-27T13:31:58.256156+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:31:59.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:59 smithi099 bash[9889]: cephadm 2021-01-27T13:31:58.259218+0000 mgr.y (mgr.14138) 79 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:31:59.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:59 smithi099 bash[9889]: audit 2021-01-27T13:31:58.259685+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:31:59.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:59 smithi099 bash[9889]: audit 2021-01-27T13:31:58.261007+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:31:59.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:31:59 smithi099 bash[9889]: audit 2021-01-27T13:31:58.262710+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:01.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:01 smithi037 bash[9724]: cluster 2021-01-27T13:32:00.061382+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:01.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:01 smithi037 bash[9724]: cluster 2021-01-27T13:32:00.781623+0000 mon.a (mon.0) 228 : cluster [DBG] Standby manager daemon x started 2021-01-27T13:32:01.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:01 smithi037 bash[9724]: audit 2021-01-27T13:32:00.784235+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.99:0/1142874444' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T13:32:01.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:01 smithi037 bash[9724]: audit 2021-01-27T13:32:00.786264+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.99:0/1142874444' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T13:32:01.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:01 smithi037 bash[13442]: cluster 2021-01-27T13:32:00.061382+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:01.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:01 smithi037 bash[13442]: cluster 2021-01-27T13:32:00.781623+0000 mon.a (mon.0) 228 : cluster [DBG] Standby manager daemon x started 2021-01-27T13:32:01.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:01 smithi037 bash[13442]: audit 2021-01-27T13:32:00.784235+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.99:0/1142874444' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T13:32:01.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:01 smithi037 bash[13442]: audit 2021-01-27T13:32:00.786264+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.99:0/1142874444' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T13:32:01.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:01 smithi099 bash[9889]: cluster 2021-01-27T13:32:00.061382+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:01.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:01 smithi099 bash[9889]: cluster 2021-01-27T13:32:00.781623+0000 mon.a (mon.0) 228 : cluster [DBG] Standby manager daemon x started 2021-01-27T13:32:01.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:01 smithi099 bash[9889]: audit 2021-01-27T13:32:00.784235+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.15.99:0/1142874444' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T13:32:01.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:01 smithi099 bash[9889]: audit 2021-01-27T13:32:00.786264+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.99:0/1142874444' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T13:32:02.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:02 smithi099 bash[9889]: cluster 2021-01-27T13:32:01.087508+0000 mon.a (mon.0) 229 : cluster [DBG] mgrmap e14: y(active, since 107s), standbys: x 2021-01-27T13:32:02.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:02 smithi099 bash[9889]: audit 2021-01-27T13:32:01.087732+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T13:32:02.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:02 smithi037 bash[9724]: cluster 2021-01-27T13:32:01.087508+0000 mon.a (mon.0) 229 : cluster [DBG] mgrmap e14: y(active, since 107s), standbys: x 2021-01-27T13:32:02.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:02 smithi037 bash[9724]: audit 2021-01-27T13:32:01.087732+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T13:32:02.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:02 smithi037 bash[13442]: cluster 2021-01-27T13:32:01.087508+0000 mon.a (mon.0) 229 : cluster [DBG] mgrmap e14: y(active, since 107s), standbys: x 2021-01-27T13:32:02.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:02 smithi037 bash[13442]: audit 2021-01-27T13:32:01.087732+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T13:32:03.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:03 smithi099 bash[9889]: cluster 2021-01-27T13:32:02.061890+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:03.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:03 smithi099 bash[9889]: audit 2021-01-27T13:32:02.528302+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.37:0/3323370355' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]: dispatch 2021-01-27T13:32:03.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:03 smithi099 bash[9889]: audit 2021-01-27T13:32:02.528809+0000 mon.a (mon.0) 231 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]: dispatch 2021-01-27T13:32:03.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:03 smithi099 bash[9889]: audit 2021-01-27T13:32:02.535812+0000 mon.a (mon.0) 232 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]': finished 2021-01-27T13:32:03.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:03 smithi099 bash[9889]: cluster 2021-01-27T13:32:02.536018+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T13:32:03.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:03 smithi099 bash[9889]: audit 2021-01-27T13:32:02.536250+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:03.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[9724]: cluster 2021-01-27T13:32:02.061890+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:03.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[9724]: audit 2021-01-27T13:32:02.528302+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.37:0/3323370355' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]: dispatch 2021-01-27T13:32:03.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[9724]: audit 2021-01-27T13:32:02.528809+0000 mon.a (mon.0) 231 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]: dispatch 2021-01-27T13:32:03.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[9724]: audit 2021-01-27T13:32:02.535812+0000 mon.a (mon.0) 232 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]': finished 2021-01-27T13:32:03.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[9724]: cluster 2021-01-27T13:32:02.536018+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T13:32:03.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[9724]: audit 2021-01-27T13:32:02.536250+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[13442]: cluster 2021-01-27T13:32:02.061890+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[13442]: audit 2021-01-27T13:32:02.528302+0000 mon.c (mon.1) 3 : audit [INF] from='client.? 172.21.15.37:0/3323370355' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]: dispatch 2021-01-27T13:32:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[13442]: audit 2021-01-27T13:32:02.528809+0000 mon.a (mon.0) 231 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]: dispatch 2021-01-27T13:32:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[13442]: audit 2021-01-27T13:32:02.535812+0000 mon.a (mon.0) 232 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93075704-87a9-40ed-b48b-0f0d6d82e21a"}]': finished 2021-01-27T13:32:03.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[13442]: cluster 2021-01-27T13:32:02.536018+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T13:32:03.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:03 smithi037 bash[13442]: audit 2021-01-27T13:32:02.536250+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:04.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:04 smithi099 bash[9889]: audit 2021-01-27T13:32:03.185026+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.37:0/3638988213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:32:04.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:04 smithi037 bash[9724]: audit 2021-01-27T13:32:03.185026+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.37:0/3638988213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:32:04.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:04 smithi037 bash[13442]: audit 2021-01-27T13:32:03.185026+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.15.37:0/3638988213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:32:05.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:05 smithi099 bash[9889]: cluster 2021-01-27T13:32:04.062341+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:05.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:05 smithi037 bash[9724]: cluster 2021-01-27T13:32:04.062341+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:05.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:05 smithi037 bash[13442]: cluster 2021-01-27T13:32:04.062341+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:07.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:07 smithi099 bash[9889]: cluster 2021-01-27T13:32:06.062855+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:07.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:07 smithi099 bash[9889]: audit 2021-01-27T13:32:06.423280+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:07.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:07 smithi037 bash[9724]: cluster 2021-01-27T13:32:06.062855+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:07.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:07 smithi037 bash[9724]: audit 2021-01-27T13:32:06.423280+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:07.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:07 smithi037 bash[13442]: cluster 2021-01-27T13:32:06.062855+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:07.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:07 smithi037 bash[13442]: audit 2021-01-27T13:32:06.423280+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:09.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:09 smithi099 bash[9889]: cluster 2021-01-27T13:32:08.063457+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:09.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:09 smithi037 bash[13442]: cluster 2021-01-27T13:32:08.063457+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:09.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:09 smithi037 bash[9724]: cluster 2021-01-27T13:32:08.063457+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:10.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:10 smithi037 bash[9724]: cluster 2021-01-27T13:32:09.049248+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T13:32:10.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:10 smithi037 bash[13442]: cluster 2021-01-27T13:32:09.049248+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T13:32:10.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:10 smithi099 bash[9889]: cluster 2021-01-27T13:32:09.049248+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T13:32:11.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[9724]: cluster 2021-01-27T13:32:10.063976+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:11.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[9724]: audit 2021-01-27T13:32:10.857637+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T13:32:11.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[9724]: audit 2021-01-27T13:32:10.859232+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:11.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[9724]: cephadm 2021-01-27T13:32:10.860416+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon osd.0 on smithi037 2021-01-27T13:32:11.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[9724]: audit 2021-01-27T13:32:10.861103+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T13:32:11.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[13442]: cluster 2021-01-27T13:32:10.063976+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:11.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[13442]: audit 2021-01-27T13:32:10.857637+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T13:32:11.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[13442]: audit 2021-01-27T13:32:10.859232+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:11.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[13442]: cephadm 2021-01-27T13:32:10.860416+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon osd.0 on smithi037 2021-01-27T13:32:11.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:11 smithi037 bash[13442]: audit 2021-01-27T13:32:10.861103+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T13:32:11.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:11 smithi099 bash[9889]: cluster 2021-01-27T13:32:10.063976+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:11.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:11 smithi099 bash[9889]: audit 2021-01-27T13:32:10.857637+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T13:32:11.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:11 smithi099 bash[9889]: audit 2021-01-27T13:32:10.859232+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:11.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:11 smithi099 bash[9889]: cephadm 2021-01-27T13:32:10.860416+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon osd.0 on smithi037 2021-01-27T13:32:11.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:11 smithi099 bash[9889]: audit 2021-01-27T13:32:10.861103+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T13:32:13.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:13 smithi037 bash[9724]: cluster 2021-01-27T13:32:12.064583+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:13.439 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:13 smithi037 bash[13442]: cluster 2021-01-27T13:32:12.064583+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:13.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:13 smithi099 bash[9889]: cluster 2021-01-27T13:32:12.064583+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:13.607 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2021-01-27T13:32:14.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:14 smithi099 bash[9889]: cephadm 2021-01-27T13:32:13.601933+0000 mgr.y (mgr.14138) 88 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:32:14.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:14 smithi099 bash[9889]: audit 2021-01-27T13:32:13.602146+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:14.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:14 smithi099 bash[9889]: audit 2021-01-27T13:32:13.606744+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:14.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:14 smithi037 bash[9724]: cephadm 2021-01-27T13:32:13.601933+0000 mgr.y (mgr.14138) 88 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:32:14.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:14 smithi037 bash[9724]: audit 2021-01-27T13:32:13.602146+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:14.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:14 smithi037 bash[9724]: audit 2021-01-27T13:32:13.606744+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:14.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:14 smithi037 bash[13442]: cephadm 2021-01-27T13:32:13.601933+0000 mgr.y (mgr.14138) 88 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:32:14.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:14 smithi037 bash[13442]: audit 2021-01-27T13:32:13.602146+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:14.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:14 smithi037 bash[13442]: audit 2021-01-27T13:32:13.606744+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:15.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[9724]: cluster 2021-01-27T13:32:14.065050+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:15.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[9724]: audit 2021-01-27T13:32:14.255687+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:32:15.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[9724]: audit 2021-01-27T13:32:14.258648+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:32:15.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[9724]: audit 2021-01-27T13:32:14.656580+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:15.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[9724]: audit 2021-01-27T13:32:14.658050+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[13442]: cluster 2021-01-27T13:32:14.065050+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[13442]: audit 2021-01-27T13:32:14.255687+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:32:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[13442]: audit 2021-01-27T13:32:14.258648+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:32:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[13442]: audit 2021-01-27T13:32:14.656580+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:15.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:15 smithi037 bash[13442]: audit 2021-01-27T13:32:14.658050+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:15.364 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@osd.0.service 2021-01-27T13:32:15.367 INFO:tasks.cephadm:Deploying osd.1 on smithi037 with /dev/vg_nvme/lv_3... 2021-01-27T13:32:15.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-27T13:32:15.458 INFO:journalctl@ceph.osd.0.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:32:15.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:15 smithi099 bash[9889]: cluster 2021-01-27T13:32:14.065050+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:15.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:15 smithi099 bash[9889]: audit 2021-01-27T13:32:14.255687+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:32:15.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:15 smithi099 bash[9889]: audit 2021-01-27T13:32:14.258648+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:32:15.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:15 smithi099 bash[9889]: audit 2021-01-27T13:32:14.656580+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:15.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:15 smithi099 bash[9889]: audit 2021-01-27T13:32:14.658050+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:17.071 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:16 smithi037 bash[16216]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-27T13:32:17.071 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:16 smithi037 bash[16216]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-01-27T13:32:17.072 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:16 smithi037 bash[16216]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-01-27T13:32:17.072 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:16 smithi037 bash[16216]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-01-27T13:32:17.072 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:16 smithi037 bash[16216]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-27T13:32:17.072 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:16 smithi037 bash[16216]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-27T13:32:17.072 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:16 smithi037 bash[16216]: --> ceph-volume lvm activate successful for osd ID: 0 2021-01-27T13:32:17.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:17 smithi099 bash[9889]: cluster 2021-01-27T13:32:16.065678+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:17.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:17 smithi037 bash[13442]: cluster 2021-01-27T13:32:16.065678+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:17.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:17 smithi037 bash[9724]: cluster 2021-01-27T13:32:16.065678+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:19.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:19 smithi099 bash[9889]: cluster 2021-01-27T13:32:18.066277+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:19.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:19 smithi037 bash[9724]: cluster 2021-01-27T13:32:18.066277+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:19.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:19 smithi037 bash[13442]: cluster 2021-01-27T13:32:18.066277+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:21.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:21 smithi099 bash[9889]: cluster 2021-01-27T13:32:20.066844+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:21.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[9724]: cluster 2021-01-27T13:32:20.066844+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:21.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[13442]: cluster 2021-01-27T13:32:20.066844+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:21.821 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 -- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 msgr2=0x558599ec4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T13:32:21.822 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 -- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 msgr2=0x558599ec4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T13:32:21.822 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).handle_read_frame_preamble_main r=0 2021-01-27T13:32:21.822 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_MESSAGE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).throttle_message 2021-01-27T13:32:21.823 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_BYTES pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).throttle_bytes 2021-01-27T13:32:21.823 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).throttle_dispatch_queue 2021-01-27T13:32:21.823 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).read_frame_segment seg_idx=0 2021-01-27T13:32:21.823 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).read_frame_segment seg_idx=1 2021-01-27T13:32:21.823 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 -- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 msgr2=0x558599ec4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T13:32:21.824 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).handle_read_frame_segment r=0 2021-01-27T13:32:21.824 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 -- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 msgr2=0x558599ec4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T13:32:21.824 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).handle_read_frame_epilogue_main r=0 2021-01-27T13:32:21.824 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 10 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).handle_read_frame_dispatch tag=17 2021-01-27T13:32:21.825 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).handle_message 2021-01-27T13:32:21.825 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 5 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-27T13:32:21.825 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 5 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=READ_MESSAGE_COMPLETE pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).handle_message received message m=0x558599ed84e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T13:32:21.825 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 -- 172.21.15.37:0/2847582446 queue 0x558599ed84e0 prio 196 2021-01-27T13:32:21.826 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 --2- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 0x558599ec4300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x558599ed3ec0 tx=0x558599f08d80).read_frame 2021-01-27T13:32:21.826 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f49f66700 20 -- 172.21.15.37:0/2847582446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558599f57400 msgr2=0x558599ec4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T13:32:21.826 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f48763700 1 -- 172.21.15.37:0/2847582446 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558599ed84e0 con 0x558599f57400 2021-01-27T13:32:21.826 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f48763700 10 -- 172.21.15.37:0/2847582446 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T13:32:21.827 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:21 smithi037 bash[16533]: debug 2021-01-27T13:32:21.617+0000 7f7f48763700 20 -- 172.21.15.37:0/2847582446 done calling dispatch on 0x558599ed84e0 2021-01-27T13:32:22.571 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:22 smithi037 bash[16533]: debug 2021-01-27T13:32:22.173+0000 7f7f501ee200 -1 Falling back to public interface 2021-01-27T13:32:22.904 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-27T13:32:22.905 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-27T13:32:22.905 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2021-01-27T13:32:22.905 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2021-01-27T13:32:22.905 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0200196 s, 524 MB/s 2021-01-27T13:32:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2021-01-27T13:32:23.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:23 smithi037 bash[9724]: cluster 2021-01-27T13:32:22.067390+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:23.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:23 smithi037 bash[13442]: cluster 2021-01-27T13:32:22.067390+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:23.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:23 smithi099 bash[9889]: cluster 2021-01-27T13:32:22.067390+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:23.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2021-01-27T13:32:25.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:25 smithi037 bash[9724]: cluster 2021-01-27T13:32:24.067966+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:25.435 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:25 smithi037 bash[13442]: cluster 2021-01-27T13:32:24.067966+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:25.435 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:25 smithi037 bash[16533]: debug 2021-01-27T13:32:25.261+0000 7f7f501ee200 -1 osd.0 0 log_to_monitors {default=true} 2021-01-27T13:32:25.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:25 smithi099 bash[9889]: cluster 2021-01-27T13:32:24.067966+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:26.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:26 smithi099 bash[9889]: audit 2021-01-27T13:32:25.171340+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:26.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:26 smithi099 bash[9889]: audit 2021-01-27T13:32:25.274065+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T13:32:26.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:26 smithi099 bash[9889]: audit 2021-01-27T13:32:25.274524+0000 mon.a (mon.0) 247 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T13:32:26.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:26 smithi099 bash[9889]: audit 2021-01-27T13:32:25.548204+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:26 smithi099 bash[9889]: audit 2021-01-27T13:32:25.554385+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:26 smithi099 bash[9889]: cephadm 2021-01-27T13:32:25.555625+0000 mgr.y (mgr.14138) 95 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:26.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:26 smithi099 bash[9889]: audit 2021-01-27T13:32:25.561481+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:26 smithi099 bash[9889]: cephadm 2021-01-27T13:32:25.562575+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:26.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[13442]: audit 2021-01-27T13:32:25.171340+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:26.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[13442]: audit 2021-01-27T13:32:25.274065+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T13:32:26.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[13442]: audit 2021-01-27T13:32:25.274524+0000 mon.a (mon.0) 247 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T13:32:26.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[13442]: audit 2021-01-27T13:32:25.548204+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[13442]: audit 2021-01-27T13:32:25.554385+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[13442]: cephadm 2021-01-27T13:32:25.555625+0000 mgr.y (mgr.14138) 95 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:26.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[13442]: audit 2021-01-27T13:32:25.561481+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[13442]: cephadm 2021-01-27T13:32:25.562575+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:26.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[9724]: audit 2021-01-27T13:32:25.171340+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:26.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[9724]: audit 2021-01-27T13:32:25.274065+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T13:32:26.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[9724]: audit 2021-01-27T13:32:25.274524+0000 mon.a (mon.0) 247 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T13:32:26.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[9724]: audit 2021-01-27T13:32:25.548204+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[9724]: audit 2021-01-27T13:32:25.554385+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[9724]: cephadm 2021-01-27T13:32:25.555625+0000 mgr.y (mgr.14138) 95 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:26.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[9724]: audit 2021-01-27T13:32:25.561481+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:26.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:26 smithi037 bash[9724]: cephadm 2021-01-27T13:32:25.562575+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:27.413 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[16533]: debug 2021-01-27T13:32:27.157+0000 7f7f4675f700 -1 osd.0 0 waiting for initial osdmap 2021-01-27T13:32:27.413 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[13442]: cluster 2021-01-27T13:32:26.068563+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:27.414 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[13442]: audit 2021-01-27T13:32:26.138554+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T13:32:27.414 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[13442]: cluster 2021-01-27T13:32:26.138737+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T13:32:27.414 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[13442]: audit 2021-01-27T13:32:26.139601+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:27.414 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[13442]: audit 2021-01-27T13:32:26.141488+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:27.415 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[13442]: audit 2021-01-27T13:32:26.149881+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:27.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[9724]: cluster 2021-01-27T13:32:26.068563+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:27.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[9724]: audit 2021-01-27T13:32:26.138554+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T13:32:27.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[9724]: cluster 2021-01-27T13:32:26.138737+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T13:32:27.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[9724]: audit 2021-01-27T13:32:26.139601+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:27.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[9724]: audit 2021-01-27T13:32:26.141488+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:27.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:27 smithi037 bash[9724]: audit 2021-01-27T13:32:26.149881+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:27.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:27 smithi099 bash[9889]: cluster 2021-01-27T13:32:26.068563+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:27.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:27 smithi099 bash[9889]: audit 2021-01-27T13:32:26.138554+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T13:32:27.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:27 smithi099 bash[9889]: cluster 2021-01-27T13:32:26.138737+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T13:32:27.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:27 smithi099 bash[9889]: audit 2021-01-27T13:32:26.139601+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:27.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:27 smithi099 bash[9889]: audit 2021-01-27T13:32:26.141488+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:27.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:27 smithi099 bash[9889]: audit 2021-01-27T13:32:26.149881+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:28.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: audit 2021-01-27T13:32:27.152855+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:32:28.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: cluster 2021-01-27T13:32:27.153051+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T13:32:28.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: audit 2021-01-27T13:32:27.153755+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:28.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: audit 2021-01-27T13:32:27.165995+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:28.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: audit 2021-01-27T13:32:27.761244+0000 mgr.y (mgr.14138) 98 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:32:28.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: audit 2021-01-27T13:32:27.763235+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:32:28.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: cephadm 2021-01-27T13:32:27.765324+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:32:28.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: audit 2021-01-27T13:32:27.765753+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:32:28.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: audit 2021-01-27T13:32:27.766894+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:28.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:28 smithi099 bash[9889]: audit 2021-01-27T13:32:27.768172+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:28.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: audit 2021-01-27T13:32:27.152855+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:32:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: cluster 2021-01-27T13:32:27.153051+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T13:32:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: audit 2021-01-27T13:32:27.153755+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: audit 2021-01-27T13:32:27.165995+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: audit 2021-01-27T13:32:27.761244+0000 mgr.y (mgr.14138) 98 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:32:28.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: audit 2021-01-27T13:32:27.763235+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:32:28.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: cephadm 2021-01-27T13:32:27.765324+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:32:28.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: audit 2021-01-27T13:32:27.765753+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:32:28.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: audit 2021-01-27T13:32:27.766894+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:28.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[9724]: audit 2021-01-27T13:32:27.768172+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:28.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: audit 2021-01-27T13:32:27.152855+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:32:28.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: cluster 2021-01-27T13:32:27.153051+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T13:32:28.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: audit 2021-01-27T13:32:27.153755+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:28.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: audit 2021-01-27T13:32:27.165995+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:28.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: audit 2021-01-27T13:32:27.761244+0000 mgr.y (mgr.14138) 98 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:32:28.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: audit 2021-01-27T13:32:27.763235+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:32:28.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: cephadm 2021-01-27T13:32:27.765324+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:32:28.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: audit 2021-01-27T13:32:27.765753+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:32:28.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: audit 2021-01-27T13:32:27.766894+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:28.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:28 smithi037 bash[13442]: audit 2021-01-27T13:32:27.768172+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:29.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:29 smithi099 bash[9889]: cluster 2021-01-27T13:32:26.313346+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:32:29.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:29 smithi099 bash[9889]: cluster 2021-01-27T13:32:26.313548+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:32:29.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:29 smithi099 bash[9889]: cluster 2021-01-27T13:32:28.068955+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v66: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:29.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:29 smithi099 bash[9889]: audit 2021-01-27T13:32:28.162601+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:29.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:29 smithi099 bash[9889]: cluster 2021-01-27T13:32:28.167137+0000 mon.a (mon.0) 264 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:32:29.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:29 smithi099 bash[9889]: cluster 2021-01-27T13:32:28.167219+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T13:32:29.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:29 smithi099 bash[9889]: audit 2021-01-27T13:32:28.168003+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:29.562 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[13442]: cluster 2021-01-27T13:32:26.313346+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:32:29.562 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[13442]: cluster 2021-01-27T13:32:26.313548+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:32:29.562 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[13442]: cluster 2021-01-27T13:32:28.068955+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v66: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:29.562 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[13442]: audit 2021-01-27T13:32:28.162601+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:29.563 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[13442]: cluster 2021-01-27T13:32:28.167137+0000 mon.a (mon.0) 264 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:32:29.563 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[13442]: cluster 2021-01-27T13:32:28.167219+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T13:32:29.563 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[13442]: audit 2021-01-27T13:32:28.168003+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:29.563 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[9724]: cluster 2021-01-27T13:32:26.313346+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:32:29.563 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[9724]: cluster 2021-01-27T13:32:26.313548+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:32:29.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[9724]: cluster 2021-01-27T13:32:28.068955+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v66: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T13:32:29.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[9724]: audit 2021-01-27T13:32:28.162601+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:29.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[9724]: cluster 2021-01-27T13:32:28.167137+0000 mon.a (mon.0) 264 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:32:29.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[9724]: cluster 2021-01-27T13:32:28.167219+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T13:32:29.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:29 smithi037 bash[9724]: audit 2021-01-27T13:32:28.168003+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:32:30.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:30 smithi099 bash[9889]: cluster 2021-01-27T13:32:29.179159+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T13:32:30.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:30 smithi037 bash[9724]: cluster 2021-01-27T13:32:29.179159+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T13:32:30.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:30 smithi037 bash[13442]: cluster 2021-01-27T13:32:29.179159+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T13:32:31.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:31 smithi099 bash[9889]: cluster 2021-01-27T13:32:30.069586+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:31.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:31 smithi099 bash[9889]: cluster 2021-01-27T13:32:30.183062+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T13:32:31.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:31 smithi099 bash[9889]: cluster 2021-01-27T13:32:30.187909+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T13:32:31.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:31 smithi037 bash[9724]: cluster 2021-01-27T13:32:30.069586+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:31.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:31 smithi037 bash[9724]: cluster 2021-01-27T13:32:30.183062+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T13:32:31.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:31 smithi037 bash[9724]: cluster 2021-01-27T13:32:30.187909+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T13:32:31.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:31 smithi037 bash[13442]: cluster 2021-01-27T13:32:30.069586+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:31.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:31 smithi037 bash[13442]: cluster 2021-01-27T13:32:30.183062+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T13:32:31.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:31 smithi037 bash[13442]: cluster 2021-01-27T13:32:30.187909+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T13:32:32.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:32 smithi099 bash[9889]: audit 2021-01-27T13:32:32.046131+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.37:0/1906126168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]: dispatch 2021-01-27T13:32:32.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:32 smithi099 bash[9889]: audit 2021-01-27T13:32:32.046684+0000 mon.a (mon.0) 270 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]: dispatch 2021-01-27T13:32:32.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:32 smithi099 bash[9889]: audit 2021-01-27T13:32:32.051849+0000 mon.a (mon.0) 271 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]': finished 2021-01-27T13:32:32.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:32 smithi099 bash[9889]: cluster 2021-01-27T13:32:32.051919+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T13:32:32.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:32 smithi099 bash[9889]: audit 2021-01-27T13:32:32.052139+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:32.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[9724]: audit 2021-01-27T13:32:32.046131+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.37:0/1906126168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]: dispatch 2021-01-27T13:32:32.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[9724]: audit 2021-01-27T13:32:32.046684+0000 mon.a (mon.0) 270 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]: dispatch 2021-01-27T13:32:32.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[9724]: audit 2021-01-27T13:32:32.051849+0000 mon.a (mon.0) 271 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]': finished 2021-01-27T13:32:32.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[9724]: cluster 2021-01-27T13:32:32.051919+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T13:32:32.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[9724]: audit 2021-01-27T13:32:32.052139+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:32.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[13442]: audit 2021-01-27T13:32:32.046131+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.37:0/1906126168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]: dispatch 2021-01-27T13:32:32.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[13442]: audit 2021-01-27T13:32:32.046684+0000 mon.a (mon.0) 270 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]: dispatch 2021-01-27T13:32:32.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[13442]: audit 2021-01-27T13:32:32.051849+0000 mon.a (mon.0) 271 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce5756c1-c1b8-45c7-b29e-290411342ef1"}]': finished 2021-01-27T13:32:32.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[13442]: cluster 2021-01-27T13:32:32.051919+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T13:32:32.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:32 smithi037 bash[13442]: audit 2021-01-27T13:32:32.052139+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:33.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:33 smithi099 bash[9889]: cluster 2021-01-27T13:32:32.070228+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:33.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:33 smithi099 bash[9889]: audit 2021-01-27T13:32:32.705939+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.37:0/692562444' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:32:33.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:33 smithi037 bash[9724]: cluster 2021-01-27T13:32:32.070228+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:33.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:33 smithi037 bash[9724]: audit 2021-01-27T13:32:32.705939+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.37:0/692562444' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:32:33.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:33 smithi037 bash[13442]: cluster 2021-01-27T13:32:32.070228+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:33.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:33 smithi037 bash[13442]: audit 2021-01-27T13:32:32.705939+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.37:0/692562444' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:32:35.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:35 smithi099 bash[9889]: cluster 2021-01-27T13:32:34.070925+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:35.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:35 smithi037 bash[9724]: cluster 2021-01-27T13:32:34.070925+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:35.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:35 smithi037 bash[13442]: cluster 2021-01-27T13:32:34.070925+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:36.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:36 smithi099 bash[9889]: audit 2021-01-27T13:32:35.962073+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:36.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:36 smithi037 bash[9724]: audit 2021-01-27T13:32:35.962073+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:36.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:36 smithi037 bash[13442]: audit 2021-01-27T13:32:35.962073+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:37.531 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:37 smithi037 bash[9724]: cluster 2021-01-27T13:32:36.071641+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:37.531 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:37 smithi037 bash[9724]: cluster 2021-01-27T13:32:36.205349+0000 mon.a (mon.0) 275 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T13:32:37.532 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:37 smithi037 bash[13442]: cluster 2021-01-27T13:32:36.071641+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:37.532 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:37 smithi037 bash[13442]: cluster 2021-01-27T13:32:36.205349+0000 mon.a (mon.0) 275 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T13:32:37.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:37 smithi099 bash[9889]: cluster 2021-01-27T13:32:36.071641+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:37.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:37 smithi099 bash[9889]: cluster 2021-01-27T13:32:36.205349+0000 mon.a (mon.0) 275 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T13:32:39.331 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:39 smithi037 bash[13442]: cluster 2021-01-27T13:32:38.072312+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:39.332 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:39 smithi037 bash[9724]: cluster 2021-01-27T13:32:38.072312+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:39.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:39 smithi099 bash[9889]: cluster 2021-01-27T13:32:38.072312+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:41.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[9724]: cluster 2021-01-27T13:32:40.073045+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:41.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[9724]: audit 2021-01-27T13:32:40.602320+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T13:32:41.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[9724]: audit 2021-01-27T13:32:40.604200+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:41.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[9724]: cephadm 2021-01-27T13:32:40.605637+0000 mgr.y (mgr.14138) 107 : cephadm [INF] Deploying daemon osd.1 on smithi037 2021-01-27T13:32:41.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[9724]: audit 2021-01-27T13:32:40.606572+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T13:32:41.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[13442]: cluster 2021-01-27T13:32:40.073045+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:41.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[13442]: audit 2021-01-27T13:32:40.602320+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T13:32:41.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[13442]: audit 2021-01-27T13:32:40.604200+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:41.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[13442]: cephadm 2021-01-27T13:32:40.605637+0000 mgr.y (mgr.14138) 107 : cephadm [INF] Deploying daemon osd.1 on smithi037 2021-01-27T13:32:41.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:41 smithi037 bash[13442]: audit 2021-01-27T13:32:40.606572+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T13:32:41.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:41 smithi099 bash[9889]: cluster 2021-01-27T13:32:40.073045+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:41.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:41 smithi099 bash[9889]: audit 2021-01-27T13:32:40.602320+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T13:32:41.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:41 smithi099 bash[9889]: audit 2021-01-27T13:32:40.604200+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:41.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:41 smithi099 bash[9889]: cephadm 2021-01-27T13:32:40.605637+0000 mgr.y (mgr.14138) 107 : cephadm [INF] Deploying daemon osd.1 on smithi037 2021-01-27T13:32:41.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:41 smithi099 bash[9889]: audit 2021-01-27T13:32:40.606572+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T13:32:43.266 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 1 on host 'smithi037' 2021-01-27T13:32:43.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:43 smithi037 bash[9724]: cluster 2021-01-27T13:32:42.073799+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:43.354 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:43 smithi037 bash[13442]: cluster 2021-01-27T13:32:42.073799+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:43.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:43 smithi099 bash[9889]: cluster 2021-01-27T13:32:42.073799+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:44.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:44 smithi099 bash[9889]: audit 2021-01-27T13:32:43.263671+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:44.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:44 smithi099 bash[9889]: audit 2021-01-27T13:32:43.267603+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:44.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:44 smithi037 bash[13442]: audit 2021-01-27T13:32:43.263671+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:44.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:44 smithi037 bash[13442]: audit 2021-01-27T13:32:43.267603+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:44.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:44 smithi037 bash[9724]: audit 2021-01-27T13:32:43.263671+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:44.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:44 smithi037 bash[9724]: audit 2021-01-27T13:32:43.267603+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:45.102 DEBUG:teuthology.orchestra.run.smithi037:osd.1> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@osd.1.service 2021-01-27T13:32:45.105 INFO:tasks.cephadm:Deploying osd.2 on smithi037 with /dev/vg_nvme/lv_2... 2021-01-27T13:32:45.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-27T13:32:45.153 INFO:journalctl@ceph.osd.1.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:32:45.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:45 smithi037 bash[9724]: cluster 2021-01-27T13:32:44.074414+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:45.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:45 smithi037 bash[9724]: audit 2021-01-27T13:32:44.368885+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:45.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:45 smithi037 bash[9724]: audit 2021-01-27T13:32:44.370673+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:45.683 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:45 smithi037 bash[13442]: cluster 2021-01-27T13:32:44.074414+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:45.683 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:45 smithi037 bash[13442]: audit 2021-01-27T13:32:44.368885+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:45.683 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:45 smithi037 bash[13442]: audit 2021-01-27T13:32:44.370673+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:45.808 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:45 smithi099 bash[9889]: cluster 2021-01-27T13:32:44.074414+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:45.808 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:45 smithi099 bash[9889]: audit 2021-01-27T13:32:44.368885+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:45.808 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:45 smithi099 bash[9889]: audit 2021-01-27T13:32:44.370673+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:46.832 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:46 smithi037 bash[18687]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-27T13:32:46.833 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:46 smithi037 bash[18687]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-01-27T13:32:46.833 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:46 smithi037 bash[18687]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-01-27T13:32:46.834 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:46 smithi037 bash[18687]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-01-27T13:32:46.834 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:46 smithi037 bash[18687]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-27T13:32:46.834 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:46 smithi037 bash[18687]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-27T13:32:46.835 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:46 smithi037 bash[18687]: --> ceph-volume lvm activate successful for osd ID: 1 2021-01-27T13:32:47.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:47 smithi037 bash[13442]: cluster 2021-01-27T13:32:46.074980+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:47.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:47 smithi037 bash[9724]: cluster 2021-01-27T13:32:46.074980+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:47.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:47 smithi099 bash[9889]: cluster 2021-01-27T13:32:46.074980+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:49.278 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:49 smithi037 bash[13442]: cluster 2021-01-27T13:32:48.075611+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:49.279 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:49 smithi037 bash[9724]: cluster 2021-01-27T13:32:48.075611+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:49.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:49 smithi099 bash[9889]: cluster 2021-01-27T13:32:48.075611+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:51.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[13442]: cluster 2021-01-27T13:32:50.076152+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:51.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[9724]: cluster 2021-01-27T13:32:50.076152+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:51.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:51 smithi099 bash[9889]: cluster 2021-01-27T13:32:50.076152+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:51.627 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 -- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 msgr2=0x560c56f61e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T13:32:51.628 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 -- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 msgr2=0x560c56f61e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T13:32:51.628 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).handle_read_frame_preamble_main r=0 2021-01-27T13:32:51.628 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_MESSAGE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).throttle_message 2021-01-27T13:32:51.628 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_BYTES pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).throttle_bytes 2021-01-27T13:32:51.628 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).throttle_dispatch_queue 2021-01-27T13:32:51.629 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).read_frame_segment seg_idx=0 2021-01-27T13:32:51.630 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).read_frame_segment seg_idx=1 2021-01-27T13:32:51.630 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 -- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 msgr2=0x560c56f61e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T13:32:51.630 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).handle_read_frame_segment r=0 2021-01-27T13:32:51.630 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 -- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 msgr2=0x560c56f61e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T13:32:51.631 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).handle_read_frame_epilogue_main r=0 2021-01-27T13:32:51.631 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 10 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).handle_read_frame_dispatch tag=17 2021-01-27T13:32:51.631 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).handle_message 2021-01-27T13:32:51.631 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 5 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0 2021-01-27T13:32:51.631 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 5 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).handle_message received message m=0x560c56f764e0 seq=4 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T13:32:51.632 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 -- 172.21.15.37:0/1742213672 queue 0x560c56f764e0 prio 196 2021-01-27T13:32:51.632 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 --2- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 0x560c56f61e00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x560c56f71ec0 tx=0x560c56fa6d80).read_frame 2021-01-27T13:32:51.632 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8a38700 20 -- 172.21.15.37:0/1742213672 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x560c56ff5000 msgr2=0x560c56f61e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T13:32:51.632 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8237700 1 -- 172.21.15.37:0/1742213672 <== mon.1 v2:172.21.15.37:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560c56f764e0 con 0x560c56ff5000 2021-01-27T13:32:51.633 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8237700 10 -- 172.21.15.37:0/1742213672 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T13:32:51.634 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.405+0000 7fe3d8237700 20 -- 172.21.15.37:0/1742213672 done calling dispatch on 0x560c56f764e0 2021-01-27T13:32:52.321 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:51 smithi037 bash[19026]: debug 2021-01-27T13:32:51.957+0000 7fe3dfcc2200 -1 Falling back to public interface 2021-01-27T13:32:52.553 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-27T13:32:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-27T13:32:52.555 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2021-01-27T13:32:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2021-01-27T13:32:52.555 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0172043 s, 609 MB/s 2021-01-27T13:32:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2021-01-27T13:32:53.467 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:53 smithi037 bash[9724]: cluster 2021-01-27T13:32:52.076704+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:53.467 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:53 smithi037 bash[13442]: cluster 2021-01-27T13:32:52.076704+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:53.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:53 smithi099 bash[9889]: cluster 2021-01-27T13:32:52.076704+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:53.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2021-01-27T13:32:55.184 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:54 smithi037 bash[19026]: debug 2021-01-27T13:32:54.917+0000 7fe3dfcc2200 -1 osd.1 0 log_to_monitors {default=true} 2021-01-27T13:32:55.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[9724]: cluster 2021-01-27T13:32:54.077295+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:55.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[9724]: audit 2021-01-27T13:32:54.597596+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:55.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[9724]: audit 2021-01-27T13:32:54.931521+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T13:32:55.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[9724]: audit 2021-01-27T13:32:54.931970+0000 mon.a (mon.0) 284 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T13:32:55.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[9724]: audit 2021-01-27T13:32:54.960652+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:55.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[9724]: cephadm 2021-01-27T13:32:54.961582+0000 mgr.y (mgr.14138) 115 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:32:55.186 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[13442]: cluster 2021-01-27T13:32:54.077295+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:55.187 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[13442]: audit 2021-01-27T13:32:54.597596+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:55.187 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[13442]: audit 2021-01-27T13:32:54.931521+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T13:32:55.187 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[13442]: audit 2021-01-27T13:32:54.931970+0000 mon.a (mon.0) 284 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T13:32:55.187 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[13442]: audit 2021-01-27T13:32:54.960652+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:55.188 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:55 smithi037 bash[13442]: cephadm 2021-01-27T13:32:54.961582+0000 mgr.y (mgr.14138) 115 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:32:55.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:55 smithi099 bash[9889]: cluster 2021-01-27T13:32:54.077295+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:55.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:55 smithi099 bash[9889]: audit 2021-01-27T13:32:54.597596+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:32:55.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:55 smithi099 bash[9889]: audit 2021-01-27T13:32:54.931521+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T13:32:55.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:55 smithi099 bash[9889]: audit 2021-01-27T13:32:54.931970+0000 mon.a (mon.0) 284 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T13:32:55.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:55 smithi099 bash[9889]: audit 2021-01-27T13:32:54.960652+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:55.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:55 smithi099 bash[9889]: cephadm 2021-01-27T13:32:54.961582+0000 mgr.y (mgr.14138) 115 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:32:56.320 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[19026]: debug 2021-01-27T13:32:56.165+0000 7fe3d6233700 -1 osd.1 0 waiting for initial osdmap 2021-01-27T13:32:56.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: audit 2021-01-27T13:32:55.148259+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T13:32:56.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: cluster 2021-01-27T13:32:55.148571+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T13:32:56.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: audit 2021-01-27T13:32:55.149355+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:56.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: audit 2021-01-27T13:32:55.151279+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:56.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: audit 2021-01-27T13:32:55.159175+0000 mon.a (mon.0) 289 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:56.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: audit 2021-01-27T13:32:55.382068+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:56.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: cephadm 2021-01-27T13:32:55.383518+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:56.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: audit 2021-01-27T13:32:55.389843+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:56.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[9724]: cephadm 2021-01-27T13:32:55.391248+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:56.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: audit 2021-01-27T13:32:55.148259+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T13:32:56.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: cluster 2021-01-27T13:32:55.148571+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T13:32:56.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: audit 2021-01-27T13:32:55.149355+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:56.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: audit 2021-01-27T13:32:55.151279+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:56.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: audit 2021-01-27T13:32:55.159175+0000 mon.a (mon.0) 289 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:56.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: audit 2021-01-27T13:32:55.382068+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:56.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: cephadm 2021-01-27T13:32:55.383518+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:56.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: audit 2021-01-27T13:32:55.389843+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:56.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:56 smithi037 bash[13442]: cephadm 2021-01-27T13:32:55.391248+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:56.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: audit 2021-01-27T13:32:55.148259+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T13:32:56.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: cluster 2021-01-27T13:32:55.148571+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T13:32:56.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: audit 2021-01-27T13:32:55.149355+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:56.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: audit 2021-01-27T13:32:55.151279+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:56.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: audit 2021-01-27T13:32:55.159175+0000 mon.a (mon.0) 289 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:32:56.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: audit 2021-01-27T13:32:55.382068+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:56.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: cephadm 2021-01-27T13:32:55.383518+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:56.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: audit 2021-01-27T13:32:55.389843+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:32:56.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:56 smithi099 bash[9889]: cephadm 2021-01-27T13:32:55.391248+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:32:57.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[9724]: cluster 2021-01-27T13:32:56.077898+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v85: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:57.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[9724]: audit 2021-01-27T13:32:56.161508+0000 mon.a (mon.0) 292 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:32:57.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[9724]: cluster 2021-01-27T13:32:56.161871+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T13:32:57.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[9724]: audit 2021-01-27T13:32:56.162775+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:57.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[9724]: audit 2021-01-27T13:32:56.170775+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:57.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[13442]: cluster 2021-01-27T13:32:56.077898+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v85: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:57.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[13442]: audit 2021-01-27T13:32:56.161508+0000 mon.a (mon.0) 292 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:32:57.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[13442]: cluster 2021-01-27T13:32:56.161871+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T13:32:57.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[13442]: audit 2021-01-27T13:32:56.162775+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:57.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:57 smithi037 bash[13442]: audit 2021-01-27T13:32:56.170775+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:57.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:57 smithi099 bash[9889]: cluster 2021-01-27T13:32:56.077898+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v85: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:57.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:57 smithi099 bash[9889]: audit 2021-01-27T13:32:56.161508+0000 mon.a (mon.0) 292 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:32:57.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:57 smithi099 bash[9889]: cluster 2021-01-27T13:32:56.161871+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T13:32:57.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:57 smithi099 bash[9889]: audit 2021-01-27T13:32:56.162775+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:57.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:57 smithi099 bash[9889]: audit 2021-01-27T13:32:56.170775+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:58.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: cluster 2021-01-27T13:32:55.954556+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:32:58.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: cluster 2021-01-27T13:32:55.954775+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:32:58.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: audit 2021-01-27T13:32:57.173825+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:58.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: cluster 2021-01-27T13:32:57.179191+0000 mon.a (mon.0) 297 : cluster [INF] osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624] boot 2021-01-27T13:32:58.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: cluster 2021-01-27T13:32:57.179257+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T13:32:58.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: audit 2021-01-27T13:32:57.179435+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:58.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: audit 2021-01-27T13:32:57.373366+0000 mgr.y (mgr.14138) 119 : audit [DBG] from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:32:58.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: audit 2021-01-27T13:32:57.374570+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:32:58.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: cephadm 2021-01-27T13:32:57.376482+0000 mgr.y (mgr.14138) 120 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:32:58.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: audit 2021-01-27T13:32:57.376881+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:32:58.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: audit 2021-01-27T13:32:57.378263+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:58.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:58 smithi099 bash[9889]: audit 2021-01-27T13:32:57.379811+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:58.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: cluster 2021-01-27T13:32:55.954556+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:32:58.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: cluster 2021-01-27T13:32:55.954775+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:32:58.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: audit 2021-01-27T13:32:57.173825+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:58.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: cluster 2021-01-27T13:32:57.179191+0000 mon.a (mon.0) 297 : cluster [INF] osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624] boot 2021-01-27T13:32:58.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: cluster 2021-01-27T13:32:57.179257+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T13:32:58.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: audit 2021-01-27T13:32:57.179435+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:58.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: audit 2021-01-27T13:32:57.373366+0000 mgr.y (mgr.14138) 119 : audit [DBG] from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:32:58.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: audit 2021-01-27T13:32:57.374570+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:32:58.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: cephadm 2021-01-27T13:32:57.376482+0000 mgr.y (mgr.14138) 120 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:32:58.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: audit 2021-01-27T13:32:57.376881+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:32:58.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: audit 2021-01-27T13:32:57.378263+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:58.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[9724]: audit 2021-01-27T13:32:57.379811+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:58.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: cluster 2021-01-27T13:32:55.954556+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:32:58.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: cluster 2021-01-27T13:32:55.954775+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:32:58.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: audit 2021-01-27T13:32:57.173825+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:58.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: cluster 2021-01-27T13:32:57.179191+0000 mon.a (mon.0) 297 : cluster [INF] osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624] boot 2021-01-27T13:32:58.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: cluster 2021-01-27T13:32:57.179257+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T13:32:58.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: audit 2021-01-27T13:32:57.179435+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:32:58.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: audit 2021-01-27T13:32:57.373366+0000 mgr.y (mgr.14138) 119 : audit [DBG] from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:32:58.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: audit 2021-01-27T13:32:57.374570+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:32:58.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: cephadm 2021-01-27T13:32:57.376482+0000 mgr.y (mgr.14138) 120 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:32:58.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: audit 2021-01-27T13:32:57.376881+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:32:58.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: audit 2021-01-27T13:32:57.378263+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:32:58.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:58 smithi037 bash[13442]: audit 2021-01-27T13:32:57.379811+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:32:59.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:59 smithi099 bash[9889]: cluster 2021-01-27T13:32:58.078442+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v88: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:59.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:32:59 smithi099 bash[9889]: cluster 2021-01-27T13:32:58.184527+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T13:32:59.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:59 smithi037 bash[9724]: cluster 2021-01-27T13:32:58.078442+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v88: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:59.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:32:59 smithi037 bash[9724]: cluster 2021-01-27T13:32:58.184527+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T13:32:59.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:59 smithi037 bash[13442]: cluster 2021-01-27T13:32:58.078442+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v88: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T13:32:59.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:32:59 smithi037 bash[13442]: cluster 2021-01-27T13:32:58.184527+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T13:33:01.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:01 smithi099 bash[9889]: cluster 2021-01-27T13:33:00.079016+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v90: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:01.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:01 smithi037 bash[9724]: cluster 2021-01-27T13:33:00.079016+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v90: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:01.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:01 smithi037 bash[13442]: cluster 2021-01-27T13:33:00.079016+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v90: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:02.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:02 smithi099 bash[9889]: audit 2021-01-27T13:33:01.735017+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.37:0/2306225706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]: dispatch 2021-01-27T13:33:02.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:02 smithi099 bash[9889]: audit 2021-01-27T13:33:01.735656+0000 mon.a (mon.0) 305 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]: dispatch 2021-01-27T13:33:02.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:02 smithi099 bash[9889]: audit 2021-01-27T13:33:01.742084+0000 mon.a (mon.0) 306 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]': finished 2021-01-27T13:33:02.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:02 smithi099 bash[9889]: cluster 2021-01-27T13:33:01.742192+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T13:33:02.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:02 smithi099 bash[9889]: audit 2021-01-27T13:33:01.742342+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:02.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[9724]: audit 2021-01-27T13:33:01.735017+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.37:0/2306225706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]: dispatch 2021-01-27T13:33:02.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[9724]: audit 2021-01-27T13:33:01.735656+0000 mon.a (mon.0) 305 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]: dispatch 2021-01-27T13:33:02.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[9724]: audit 2021-01-27T13:33:01.742084+0000 mon.a (mon.0) 306 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]': finished 2021-01-27T13:33:02.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[9724]: cluster 2021-01-27T13:33:01.742192+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T13:33:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[9724]: audit 2021-01-27T13:33:01.742342+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:02.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[13442]: audit 2021-01-27T13:33:01.735017+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.37:0/2306225706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]: dispatch 2021-01-27T13:33:02.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[13442]: audit 2021-01-27T13:33:01.735656+0000 mon.a (mon.0) 305 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]: dispatch 2021-01-27T13:33:02.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[13442]: audit 2021-01-27T13:33:01.742084+0000 mon.a (mon.0) 306 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6eecd04-669c-4e2b-adc6-d13bf2367c1d"}]': finished 2021-01-27T13:33:02.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[13442]: cluster 2021-01-27T13:33:01.742192+0000 mon.a (mon.0) 307 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T13:33:02.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:02 smithi037 bash[13442]: audit 2021-01-27T13:33:01.742342+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:03.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:03 smithi099 bash[9889]: cluster 2021-01-27T13:33:02.079612+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:03.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:03 smithi099 bash[9889]: audit 2021-01-27T13:33:02.382582+0000 mon.a (mon.0) 309 : audit [DBG] from='client.? 172.21.15.37:0/4181033938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:03.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:03 smithi037 bash[13442]: cluster 2021-01-27T13:33:02.079612+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:03.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:03 smithi037 bash[13442]: audit 2021-01-27T13:33:02.382582+0000 mon.a (mon.0) 309 : audit [DBG] from='client.? 172.21.15.37:0/4181033938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:03.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:03 smithi037 bash[9724]: cluster 2021-01-27T13:33:02.079612+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:03.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:03 smithi037 bash[9724]: audit 2021-01-27T13:33:02.382582+0000 mon.a (mon.0) 309 : audit [DBG] from='client.? 172.21.15.37:0/4181033938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:04.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:04 smithi099 bash[9889]: cluster 2021-01-27T13:33:04.194753+0000 mon.a (mon.0) 310 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T13:33:04.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:04 smithi099 bash[9889]: cluster 2021-01-27T13:33:04.194850+0000 mon.a (mon.0) 311 : cluster [INF] Cluster is now healthy 2021-01-27T13:33:04.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:04 smithi037 bash[9724]: cluster 2021-01-27T13:33:04.194753+0000 mon.a (mon.0) 310 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T13:33:04.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:04 smithi037 bash[9724]: cluster 2021-01-27T13:33:04.194850+0000 mon.a (mon.0) 311 : cluster [INF] Cluster is now healthy 2021-01-27T13:33:04.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:04 smithi037 bash[13442]: cluster 2021-01-27T13:33:04.194753+0000 mon.a (mon.0) 310 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T13:33:04.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:04 smithi037 bash[13442]: cluster 2021-01-27T13:33:04.194850+0000 mon.a (mon.0) 311 : cluster [INF] Cluster is now healthy 2021-01-27T13:33:05.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:05 smithi099 bash[9889]: cluster 2021-01-27T13:33:04.080087+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:05.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:05 smithi037 bash[9724]: cluster 2021-01-27T13:33:04.080087+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:05.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:05 smithi037 bash[13442]: cluster 2021-01-27T13:33:04.080087+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:06.320 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:06 smithi037 bash[13442]: audit 2021-01-27T13:33:05.629813+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:06.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:06 smithi037 bash[9724]: audit 2021-01-27T13:33:05.629813+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:06.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:06 smithi099 bash[9889]: audit 2021-01-27T13:33:05.629813+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:07.457 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:07 smithi037 bash[9724]: cluster 2021-01-27T13:33:06.080611+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:07.457 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:07 smithi037 bash[13442]: cluster 2021-01-27T13:33:06.080611+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:07.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:07 smithi099 bash[9889]: cluster 2021-01-27T13:33:06.080611+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:09.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:09 smithi037 bash[9724]: cluster 2021-01-27T13:33:08.081132+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:09.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:09 smithi037 bash[13442]: cluster 2021-01-27T13:33:08.081132+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:09.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:09 smithi099 bash[9889]: cluster 2021-01-27T13:33:08.081132+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:11.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:11 smithi099 bash[9889]: cluster 2021-01-27T13:33:10.081714+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:11.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:11 smithi099 bash[9889]: audit 2021-01-27T13:33:10.347553+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T13:33:11.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:11 smithi099 bash[9889]: audit 2021-01-27T13:33:10.349216+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:11.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:11 smithi099 bash[9889]: cephadm 2021-01-27T13:33:10.350440+0000 mgr.y (mgr.14138) 128 : cephadm [INF] Deploying daemon osd.2 on smithi037 2021-01-27T13:33:11.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:11 smithi099 bash[9889]: audit 2021-01-27T13:33:10.351305+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T13:33:11.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[9724]: cluster 2021-01-27T13:33:10.081714+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:11.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[9724]: audit 2021-01-27T13:33:10.347553+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T13:33:11.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[9724]: audit 2021-01-27T13:33:10.349216+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:11.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[9724]: cephadm 2021-01-27T13:33:10.350440+0000 mgr.y (mgr.14138) 128 : cephadm [INF] Deploying daemon osd.2 on smithi037 2021-01-27T13:33:11.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[9724]: audit 2021-01-27T13:33:10.351305+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T13:33:11.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[13442]: cluster 2021-01-27T13:33:10.081714+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:11.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[13442]: audit 2021-01-27T13:33:10.347553+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T13:33:11.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[13442]: audit 2021-01-27T13:33:10.349216+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:11.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[13442]: cephadm 2021-01-27T13:33:10.350440+0000 mgr.y (mgr.14138) 128 : cephadm [INF] Deploying daemon osd.2 on smithi037 2021-01-27T13:33:11.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:11 smithi037 bash[13442]: audit 2021-01-27T13:33:10.351305+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T13:33:13.224 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 2 on host 'smithi037' 2021-01-27T13:33:13.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:13 smithi037 bash[9724]: cluster 2021-01-27T13:33:12.082211+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:13.309 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:13 smithi037 bash[13442]: cluster 2021-01-27T13:33:12.082211+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:13.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:13 smithi099 bash[9889]: cluster 2021-01-27T13:33:12.082211+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:14.142 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:33:14 smithi037 bash[9955]: debug 2021-01-27T13:33:14.061+0000 7f441d488700 -1 calc_pg_upmaps abort due to max <= 0 2021-01-27T13:33:14.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:14 smithi099 bash[9889]: audit 2021-01-27T13:33:13.217235+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:14.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:14 smithi099 bash[9889]: audit 2021-01-27T13:33:13.224541+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:14.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:14 smithi037 bash[9724]: audit 2021-01-27T13:33:13.217235+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:14.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:14 smithi037 bash[9724]: audit 2021-01-27T13:33:13.224541+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:14.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:14 smithi037 bash[13442]: audit 2021-01-27T13:33:13.217235+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:14.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:14 smithi037 bash[13442]: audit 2021-01-27T13:33:13.224541+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:15.048 DEBUG:teuthology.orchestra.run.smithi037:osd.2> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@osd.2.service 2021-01-27T13:33:15.051 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_1... 2021-01-27T13:33:15.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-27T13:33:15.137 INFO:journalctl@ceph.osd.2.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:33:15.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[9724]: cluster 2021-01-27T13:33:14.082666+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:15.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[9724]: audit 2021-01-27T13:33:14.257548+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:33:15.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[9724]: audit 2021-01-27T13:33:14.260080+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:33:15.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[9724]: audit 2021-01-27T13:33:14.327106+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:15.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[9724]: audit 2021-01-27T13:33:14.329209+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:15.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[13442]: cluster 2021-01-27T13:33:14.082666+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:15.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[13442]: audit 2021-01-27T13:33:14.257548+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:33:15.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[13442]: audit 2021-01-27T13:33:14.260080+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:33:15.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[13442]: audit 2021-01-27T13:33:14.327106+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:15.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:15 smithi037 bash[13442]: audit 2021-01-27T13:33:14.329209+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:15.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:15 smithi099 bash[9889]: cluster 2021-01-27T13:33:14.082666+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:15.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:15 smithi099 bash[9889]: audit 2021-01-27T13:33:14.257548+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:33:15.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:15 smithi099 bash[9889]: audit 2021-01-27T13:33:14.260080+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:33:15.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:15 smithi099 bash[9889]: audit 2021-01-27T13:33:14.327106+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:15.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:15 smithi099 bash[9889]: audit 2021-01-27T13:33:14.329209+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:16.570 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:16 smithi037 bash[21173]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-27T13:33:16.571 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:16 smithi037 bash[21173]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-01-27T13:33:16.571 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:16 smithi037 bash[21173]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-01-27T13:33:16.571 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:16 smithi037 bash[21173]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-01-27T13:33:16.572 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:16 smithi037 bash[21173]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-27T13:33:16.572 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:16 smithi037 bash[21173]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-27T13:33:16.572 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:16 smithi037 bash[21173]: --> ceph-volume lvm activate successful for osd ID: 2 2021-01-27T13:33:17.533 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:17 smithi037 bash[9724]: cluster 2021-01-27T13:33:16.083263+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:17.533 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:17 smithi037 bash[13442]: cluster 2021-01-27T13:33:16.083263+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:17.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:17 smithi099 bash[9889]: cluster 2021-01-27T13:33:16.083263+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:19.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:19 smithi037 bash[9724]: cluster 2021-01-27T13:33:18.083814+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:19.355 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:19 smithi037 bash[13442]: cluster 2021-01-27T13:33:18.083814+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:19.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:19 smithi099 bash[9889]: cluster 2021-01-27T13:33:18.083814+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:21.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[9724]: cluster 2021-01-27T13:33:20.084339+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:21.219 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[13442]: cluster 2021-01-27T13:33:20.084339+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:21.219 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2c6f7700 10 -- 172.21.15.37:0/4041812134 dispatch_throttle_release 413 to dispatch throttler 413/104857600 2021-01-27T13:33:21.220 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2c6f7700 20 -- 172.21.15.37:0/4041812134 done calling dispatch on 0x55941dd14c60 2021-01-27T13:33:21.220 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 -- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 msgr2=0x55941dd09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T13:33:21.220 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 -- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 msgr2=0x55941dd09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T13:33:21.220 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).handle_read_frame_preamble_main r=0 2021-01-27T13:33:21.220 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_MESSAGE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).throttle_message 2021-01-27T13:33:21.221 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_BYTES pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).throttle_bytes 2021-01-27T13:33:21.221 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).throttle_dispatch_queue 2021-01-27T13:33:21.221 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).read_frame_segment seg_idx=0 2021-01-27T13:33:21.221 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).read_frame_segment seg_idx=1 2021-01-27T13:33:21.221 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 -- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 msgr2=0x55941dd09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T13:33:21.222 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).handle_read_frame_segment r=0 2021-01-27T13:33:21.222 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 -- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 msgr2=0x55941dd09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T13:33:21.222 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).handle_read_frame_epilogue_main r=0 2021-01-27T13:33:21.222 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 10 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).handle_read_frame_dispatch tag=17 2021-01-27T13:33:21.222 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).handle_message 2021-01-27T13:33:21.223 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 5 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-27T13:33:21.223 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 5 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).handle_message received message m=0x55941dd1e4e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T13:33:21.223 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 -- 172.21.15.37:0/4041812134 queue 0x55941dd1e4e0 prio 196 2021-01-27T13:33:21.223 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 --2- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 0x55941dd09e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x55941dd19e60 tx=0x55941dd4ed80).read_frame 2021-01-27T13:33:21.223 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2cef8700 20 -- 172.21.15.37:0/4041812134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55941dd9d000 msgr2=0x55941dd09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T13:33:21.224 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2c6f7700 1 -- 172.21.15.37:0/4041812134 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55941dd1e4e0 con 0x55941dd9d000 2021-01-27T13:33:21.224 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2c6f7700 10 -- 172.21.15.37:0/4041812134 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T13:33:21.224 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.017+0000 7f2a2c6f7700 20 -- 172.21.15.37:0/4041812134 done calling dispatch on 0x55941dd1e4e0 2021-01-27T13:33:21.474 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:21 smithi037 bash[21552]: debug 2021-01-27T13:33:21.329+0000 7f2a34182200 -1 Falling back to public interface 2021-01-27T13:33:21.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:21 smithi099 bash[9889]: cluster 2021-01-27T13:33:20.084339+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-27T13:33:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-27T13:33:22.079 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2021-01-27T13:33:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2021-01-27T13:33:22.079 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0139832 s, 750 MB/s 2021-01-27T13:33:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2021-01-27T13:33:23.045 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2021-01-27T13:33:23.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:23 smithi037 bash[9724]: cluster 2021-01-27T13:33:22.084747+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:23.251 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:23 smithi037 bash[13442]: cluster 2021-01-27T13:33:22.084747+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:23.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:23 smithi099 bash[9889]: cluster 2021-01-27T13:33:22.084747+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:24.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:24 smithi037 bash[9724]: audit 2021-01-27T13:33:23.865657+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:24.473 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:24 smithi037 bash[13442]: audit 2021-01-27T13:33:23.865657+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:24.473 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:24 smithi037 bash[21552]: debug 2021-01-27T13:33:24.345+0000 7f2a34182200 -1 osd.2 0 log_to_monitors {default=true} 2021-01-27T13:33:24.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:24 smithi099 bash[9889]: audit 2021-01-27T13:33:23.865657+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:25.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:25 smithi099 bash[9889]: cluster 2021-01-27T13:33:24.085271+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:25.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:25 smithi099 bash[9889]: audit 2021-01-27T13:33:24.238590+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:25 smithi099 bash[9889]: audit 2021-01-27T13:33:24.245490+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:25 smithi099 bash[9889]: cephadm 2021-01-27T13:33:24.247077+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:25.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:25 smithi099 bash[9889]: cephadm 2021-01-27T13:33:24.249804+0000 mgr.y (mgr.14138) 137 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:33:25.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:25 smithi099 bash[9889]: audit 2021-01-27T13:33:24.361530+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T13:33:25.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:25 smithi099 bash[9889]: audit 2021-01-27T13:33:24.677250+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:25 smithi099 bash[9889]: cephadm 2021-01-27T13:33:24.678505+0000 mgr.y (mgr.14138) 138 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:25.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[13442]: cluster 2021-01-27T13:33:24.085271+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:25.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[13442]: audit 2021-01-27T13:33:24.238590+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[13442]: audit 2021-01-27T13:33:24.245490+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[13442]: cephadm 2021-01-27T13:33:24.247077+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:25.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[13442]: cephadm 2021-01-27T13:33:24.249804+0000 mgr.y (mgr.14138) 137 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:33:25.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[13442]: audit 2021-01-27T13:33:24.361530+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T13:33:25.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[13442]: audit 2021-01-27T13:33:24.677250+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[13442]: cephadm 2021-01-27T13:33:24.678505+0000 mgr.y (mgr.14138) 138 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:25.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[9724]: cluster 2021-01-27T13:33:24.085271+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:25.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[9724]: audit 2021-01-27T13:33:24.238590+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[9724]: audit 2021-01-27T13:33:24.245490+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[9724]: cephadm 2021-01-27T13:33:24.247077+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:25.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[9724]: cephadm 2021-01-27T13:33:24.249804+0000 mgr.y (mgr.14138) 137 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:33:25.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[9724]: audit 2021-01-27T13:33:24.361530+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T13:33:25.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[9724]: audit 2021-01-27T13:33:24.677250+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:25.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:25 smithi037 bash[9724]: cephadm 2021-01-27T13:33:24.678505+0000 mgr.y (mgr.14138) 138 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:26.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:26 smithi099 bash[9889]: audit 2021-01-27T13:33:25.250281+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T13:33:26.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:26 smithi099 bash[9889]: cluster 2021-01-27T13:33:25.250384+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T13:33:26.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:26 smithi099 bash[9889]: audit 2021-01-27T13:33:25.250721+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:26.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:26 smithi099 bash[9889]: audit 2021-01-27T13:33:25.251321+0000 mon.a (mon.0) 330 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:26.570 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[21552]: debug 2021-01-27T13:33:26.257+0000 7f2a2a6f3700 -1 osd.2 0 waiting for initial osdmap 2021-01-27T13:33:26.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[13442]: audit 2021-01-27T13:33:25.250281+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T13:33:26.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[13442]: cluster 2021-01-27T13:33:25.250384+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T13:33:26.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[13442]: audit 2021-01-27T13:33:25.250721+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:26.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[13442]: audit 2021-01-27T13:33:25.251321+0000 mon.a (mon.0) 330 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:26.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[9724]: audit 2021-01-27T13:33:25.250281+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T13:33:26.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[9724]: cluster 2021-01-27T13:33:25.250384+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T13:33:26.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[9724]: audit 2021-01-27T13:33:25.250721+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:26.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:26 smithi037 bash[9724]: audit 2021-01-27T13:33:25.251321+0000 mon.a (mon.0) 330 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:27.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: cluster 2021-01-27T13:33:26.085824+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:27.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: audit 2021-01-27T13:33:26.254889+0000 mon.a (mon.0) 331 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:33:27.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: cluster 2021-01-27T13:33:26.255091+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T13:33:27.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: audit 2021-01-27T13:33:26.256019+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:27.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: audit 2021-01-27T13:33:26.264556+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:27.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: audit 2021-01-27T13:33:26.782558+0000 mgr.y (mgr.14138) 140 : audit [DBG] from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:33:27.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: audit 2021-01-27T13:33:26.783657+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:33:27.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: cephadm 2021-01-27T13:33:26.785451+0000 mgr.y (mgr.14138) 141 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:33:27.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: audit 2021-01-27T13:33:26.785839+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:33:27.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: audit 2021-01-27T13:33:26.787067+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:27.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:27 smithi099 bash[9889]: audit 2021-01-27T13:33:26.788747+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:27.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: cluster 2021-01-27T13:33:26.085824+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:27.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: audit 2021-01-27T13:33:26.254889+0000 mon.a (mon.0) 331 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:33:27.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: cluster 2021-01-27T13:33:26.255091+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T13:33:27.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: audit 2021-01-27T13:33:26.256019+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:27.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: audit 2021-01-27T13:33:26.264556+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:27.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: audit 2021-01-27T13:33:26.782558+0000 mgr.y (mgr.14138) 140 : audit [DBG] from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:33:27.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: audit 2021-01-27T13:33:26.783657+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:33:27.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: cephadm 2021-01-27T13:33:26.785451+0000 mgr.y (mgr.14138) 141 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:33:27.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: audit 2021-01-27T13:33:26.785839+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:33:27.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: audit 2021-01-27T13:33:26.787067+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:27.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[9724]: audit 2021-01-27T13:33:26.788747+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:27.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: cluster 2021-01-27T13:33:26.085824+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:27.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: audit 2021-01-27T13:33:26.254889+0000 mon.a (mon.0) 331 : audit [INF] from='osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:33:27.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: cluster 2021-01-27T13:33:26.255091+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T13:33:27.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: audit 2021-01-27T13:33:26.256019+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:27.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: audit 2021-01-27T13:33:26.264556+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:27.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: audit 2021-01-27T13:33:26.782558+0000 mgr.y (mgr.14138) 140 : audit [DBG] from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:33:27.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: audit 2021-01-27T13:33:26.783657+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:33:27.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: cephadm 2021-01-27T13:33:26.785451+0000 mgr.y (mgr.14138) 141 : cephadm [INF] Applying drive group None on host smithi037... 2021-01-27T13:33:27.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: audit 2021-01-27T13:33:26.785839+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:33:27.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: audit 2021-01-27T13:33:26.787067+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:27.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:27 smithi037 bash[13442]: audit 2021-01-27T13:33:26.788747+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:28.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:28 smithi099 bash[9889]: cluster 2021-01-27T13:33:25.389460+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:33:28.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:28 smithi099 bash[9889]: cluster 2021-01-27T13:33:25.389711+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:33:28.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:28 smithi099 bash[9889]: cluster 2021-01-27T13:33:27.267481+0000 mon.a (mon.0) 339 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:33:28.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:28 smithi099 bash[9889]: cluster 2021-01-27T13:33:27.267585+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T13:33:28.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:28 smithi099 bash[9889]: audit 2021-01-27T13:33:27.268897+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:28.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[9724]: cluster 2021-01-27T13:33:25.389460+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:33:28.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[9724]: cluster 2021-01-27T13:33:25.389711+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:33:28.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[9724]: cluster 2021-01-27T13:33:27.267481+0000 mon.a (mon.0) 339 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:33:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[9724]: cluster 2021-01-27T13:33:27.267585+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T13:33:28.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[9724]: audit 2021-01-27T13:33:27.268897+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:28.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[13442]: cluster 2021-01-27T13:33:25.389460+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:33:28.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[13442]: cluster 2021-01-27T13:33:25.389711+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:33:28.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[13442]: cluster 2021-01-27T13:33:27.267481+0000 mon.a (mon.0) 339 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:33:28.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[13442]: cluster 2021-01-27T13:33:27.267585+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T13:33:28.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:28 smithi037 bash[13442]: audit 2021-01-27T13:33:27.268897+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:33:29.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:29 smithi099 bash[9889]: cluster 2021-01-27T13:33:28.086349+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v108: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:29.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:29 smithi099 bash[9889]: cluster 2021-01-27T13:33:28.278803+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T13:33:29.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:29 smithi037 bash[13442]: cluster 2021-01-27T13:33:28.086349+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v108: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:29.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:29 smithi037 bash[13442]: cluster 2021-01-27T13:33:28.278803+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T13:33:29.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:29 smithi037 bash[9724]: cluster 2021-01-27T13:33:28.086349+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v108: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T13:33:29.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:29 smithi037 bash[9724]: cluster 2021-01-27T13:33:28.278803+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T13:33:31.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:31 smithi099 bash[9889]: cluster 2021-01-27T13:33:30.086935+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:31.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:31 smithi099 bash[9889]: audit 2021-01-27T13:33:31.099706+0000 mon.a (mon.0) 343 : audit [INF] from='client.? 172.21.15.37:0/33966625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bceaf77-1be5-46e0-8259-91102f1a4992"}]: dispatch 2021-01-27T13:33:31.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:31 smithi099 bash[9889]: audit 2021-01-27T13:33:31.105036+0000 mon.a (mon.0) 344 : audit [INF] from='client.? 172.21.15.37:0/33966625' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bceaf77-1be5-46e0-8259-91102f1a4992"}]': finished 2021-01-27T13:33:31.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:31 smithi099 bash[9889]: cluster 2021-01-27T13:33:31.105087+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T13:33:31.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:31 smithi099 bash[9889]: audit 2021-01-27T13:33:31.105353+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:31.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[9724]: cluster 2021-01-27T13:33:30.086935+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:31.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[9724]: audit 2021-01-27T13:33:31.099706+0000 mon.a (mon.0) 343 : audit [INF] from='client.? 172.21.15.37:0/33966625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bceaf77-1be5-46e0-8259-91102f1a4992"}]: dispatch 2021-01-27T13:33:31.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[9724]: audit 2021-01-27T13:33:31.105036+0000 mon.a (mon.0) 344 : audit [INF] from='client.? 172.21.15.37:0/33966625' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bceaf77-1be5-46e0-8259-91102f1a4992"}]': finished 2021-01-27T13:33:31.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[9724]: cluster 2021-01-27T13:33:31.105087+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T13:33:31.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[9724]: audit 2021-01-27T13:33:31.105353+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:31.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[13442]: cluster 2021-01-27T13:33:30.086935+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:31.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[13442]: audit 2021-01-27T13:33:31.099706+0000 mon.a (mon.0) 343 : audit [INF] from='client.? 172.21.15.37:0/33966625' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bceaf77-1be5-46e0-8259-91102f1a4992"}]: dispatch 2021-01-27T13:33:31.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[13442]: audit 2021-01-27T13:33:31.105036+0000 mon.a (mon.0) 344 : audit [INF] from='client.? 172.21.15.37:0/33966625' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bceaf77-1be5-46e0-8259-91102f1a4992"}]': finished 2021-01-27T13:33:31.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[13442]: cluster 2021-01-27T13:33:31.105087+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T13:33:31.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:31 smithi037 bash[13442]: audit 2021-01-27T13:33:31.105353+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:32.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:32 smithi099 bash[9889]: audit 2021-01-27T13:33:31.787622+0000 mon.a (mon.0) 347 : audit [DBG] from='client.? 172.21.15.37:0/3494412510' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:32.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:32 smithi037 bash[9724]: audit 2021-01-27T13:33:31.787622+0000 mon.a (mon.0) 347 : audit [DBG] from='client.? 172.21.15.37:0/3494412510' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:32.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:32 smithi037 bash[13442]: audit 2021-01-27T13:33:31.787622+0000 mon.a (mon.0) 347 : audit [DBG] from='client.? 172.21.15.37:0/3494412510' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:33.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:33 smithi099 bash[9889]: cluster 2021-01-27T13:33:32.087472+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:33.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:33 smithi037 bash[13442]: cluster 2021-01-27T13:33:32.087472+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:33.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:33 smithi037 bash[9724]: cluster 2021-01-27T13:33:32.087472+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:35.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:35 smithi099 bash[9889]: cluster 2021-01-27T13:33:34.088041+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:35.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:35 smithi099 bash[9889]: audit 2021-01-27T13:33:35.078101+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:35.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:35 smithi037 bash[13442]: cluster 2021-01-27T13:33:34.088041+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:35.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:35 smithi037 bash[13442]: audit 2021-01-27T13:33:35.078101+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:35.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:35 smithi037 bash[9724]: cluster 2021-01-27T13:33:34.088041+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:35.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:35 smithi037 bash[9724]: audit 2021-01-27T13:33:35.078101+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:37.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:37 smithi037 bash[9724]: cluster 2021-01-27T13:33:36.088590+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:37.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:37 smithi037 bash[13442]: cluster 2021-01-27T13:33:36.088590+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:37.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:37 smithi099 bash[9889]: cluster 2021-01-27T13:33:36.088590+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:39.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:39 smithi099 bash[9889]: cluster 2021-01-27T13:33:38.089018+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:39.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:39 smithi037 bash[13442]: cluster 2021-01-27T13:33:38.089018+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:39.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:39 smithi037 bash[9724]: cluster 2021-01-27T13:33:38.089018+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:40.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:40 smithi099 bash[9889]: audit 2021-01-27T13:33:39.871708+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T13:33:40.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:40 smithi099 bash[9889]: audit 2021-01-27T13:33:39.873185+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:40.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:40 smithi099 bash[9889]: cephadm 2021-01-27T13:33:39.874403+0000 mgr.y (mgr.14138) 148 : cephadm [INF] Deploying daemon osd.3 on smithi037 2021-01-27T13:33:40.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:40 smithi099 bash[9889]: audit 2021-01-27T13:33:39.875238+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T13:33:40.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:40 smithi037 bash[9724]: audit 2021-01-27T13:33:39.871708+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T13:33:40.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:40 smithi037 bash[9724]: audit 2021-01-27T13:33:39.873185+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:40.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:40 smithi037 bash[9724]: cephadm 2021-01-27T13:33:39.874403+0000 mgr.y (mgr.14138) 148 : cephadm [INF] Deploying daemon osd.3 on smithi037 2021-01-27T13:33:40.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:40 smithi037 bash[9724]: audit 2021-01-27T13:33:39.875238+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T13:33:40.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:40 smithi037 bash[13442]: audit 2021-01-27T13:33:39.871708+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T13:33:40.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:40 smithi037 bash[13442]: audit 2021-01-27T13:33:39.873185+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:40.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:40 smithi037 bash[13442]: cephadm 2021-01-27T13:33:39.874403+0000 mgr.y (mgr.14138) 148 : cephadm [INF] Deploying daemon osd.3 on smithi037 2021-01-27T13:33:40.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:40 smithi037 bash[13442]: audit 2021-01-27T13:33:39.875238+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T13:33:41.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:41 smithi037 bash[9724]: cluster 2021-01-27T13:33:40.089599+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:41.429 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:41 smithi037 bash[13442]: cluster 2021-01-27T13:33:40.089599+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:41.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:41 smithi099 bash[9889]: cluster 2021-01-27T13:33:40.089599+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:42.812 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2021-01-27T13:33:43.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:43 smithi037 bash[9724]: cluster 2021-01-27T13:33:42.090162+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:43.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:43 smithi037 bash[9724]: audit 2021-01-27T13:33:42.808056+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:43.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:43 smithi037 bash[9724]: audit 2021-01-27T13:33:42.811169+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:43.435 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:43 smithi037 bash[13442]: cluster 2021-01-27T13:33:42.090162+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:43.435 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:43 smithi037 bash[13442]: audit 2021-01-27T13:33:42.808056+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:43.435 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:43 smithi037 bash[13442]: audit 2021-01-27T13:33:42.811169+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:43.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:43 smithi099 bash[9889]: cluster 2021-01-27T13:33:42.090162+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:43.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:43 smithi099 bash[9889]: audit 2021-01-27T13:33:42.808056+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:43.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:43 smithi099 bash[9889]: audit 2021-01-27T13:33:42.811169+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:44.560 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@osd.3.service 2021-01-27T13:33:44.563 INFO:tasks.cephadm:Deploying osd.4 on smithi099 with /dev/vg_nvme/lv_4... 2021-01-27T13:33:44.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-27T13:33:44.582 INFO:journalctl@ceph.osd.3.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:33:45.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[9724]: audit 2021-01-27T13:33:44.073315+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:45.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[9724]: audit 2021-01-27T13:33:44.075401+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:45.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[9724]: cluster 2021-01-27T13:33:44.090750+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:45.501 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[13442]: audit 2021-01-27T13:33:44.073315+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:45.501 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[13442]: audit 2021-01-27T13:33:44.075401+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:45.501 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[13442]: cluster 2021-01-27T13:33:44.090750+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:45.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:45 smithi099 bash[9889]: audit 2021-01-27T13:33:44.073315+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:45.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:45 smithi099 bash[9889]: audit 2021-01-27T13:33:44.075401+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:45.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:45 smithi099 bash[9889]: cluster 2021-01-27T13:33:44.090750+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:46.169 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[23671]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-27T13:33:46.169 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[23671]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-01-27T13:33:46.169 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[23671]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-01-27T13:33:46.169 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[23671]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-01-27T13:33:46.170 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[23671]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-27T13:33:46.170 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[23671]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-27T13:33:46.170 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:45 smithi037 bash[23671]: --> ceph-volume lvm activate successful for osd ID: 3 2021-01-27T13:33:47.470 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:47 smithi099 bash[9889]: cluster 2021-01-27T13:33:46.091275+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:47.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:47 smithi037 bash[9724]: cluster 2021-01-27T13:33:46.091275+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:47.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:47 smithi037 bash[13442]: cluster 2021-01-27T13:33:46.091275+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-27T13:33:47.982 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-27T13:33:47.982 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2021-01-27T13:33:47.982 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2021-01-27T13:33:47.982 INFO:teuthology.orchestra.run.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0153364 s, 684 MB/s 2021-01-27T13:33:47.983 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2021-01-27T13:33:48.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2021-01-27T13:33:48.820 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 -- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 msgr2=0x557f63d92300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T13:33:48.820 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 -- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 msgr2=0x557f63d92300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T13:33:48.821 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).handle_read_frame_preamble_main r=0 2021-01-27T13:33:48.821 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_MESSAGE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).throttle_message 2021-01-27T13:33:48.821 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_BYTES pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).throttle_bytes 2021-01-27T13:33:48.821 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).throttle_dispatch_queue 2021-01-27T13:33:48.822 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).read_frame_segment seg_idx=0 2021-01-27T13:33:48.822 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).read_frame_segment seg_idx=1 2021-01-27T13:33:48.822 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 -- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 msgr2=0x557f63d92300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T13:33:48.822 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).handle_read_frame_segment r=0 2021-01-27T13:33:48.823 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 -- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 msgr2=0x557f63d92300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T13:33:48.823 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).handle_read_frame_epilogue_main r=0 2021-01-27T13:33:48.823 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 10 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).handle_read_frame_dispatch tag=17 2021-01-27T13:33:48.823 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).handle_message 2021-01-27T13:33:48.824 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 5 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0 2021-01-27T13:33:48.824 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 5 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=READ_MESSAGE_COMPLETE pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).handle_message received message m=0x557f63da64e0 seq=4 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T13:33:48.824 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 -- 172.21.15.37:0/1078371972 queue 0x557f63da64e0 prio 196 2021-01-27T13:33:48.825 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8bca80700 1 -- 172.21.15.37:0/1078371972 <== mon.1 v2:172.21.15.37:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557f63da64e0 con 0x557f63e25400 2021-01-27T13:33:48.825 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8bca80700 10 -- 172.21.15.37:0/1078371972 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T13:33:48.825 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8bca80700 20 -- 172.21.15.37:0/1078371972 done calling dispatch on 0x557f63da64e0 2021-01-27T13:33:48.825 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 --2- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 0x557f63d92300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x557f63da1e60 tx=0x557f63dd6180).read_frame 2021-01-27T13:33:48.826 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.669+0000 7ff8be283700 20 -- 172.21.15.37:0/1078371972 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x557f63e25400 msgr2=0x557f63d92300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T13:33:49.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:49 smithi099 bash[9889]: cluster 2021-01-27T13:33:48.091775+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:49.319 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:49 smithi037 bash[13442]: cluster 2021-01-27T13:33:48.091775+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:49.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:49 smithi037 bash[9724]: cluster 2021-01-27T13:33:48.091775+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:49.320 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:48 smithi037 bash[24020]: debug 2021-01-27T13:33:48.973+0000 7ff8c450b200 -1 Falling back to public interface 2021-01-27T13:33:51.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:51 smithi099 bash[9889]: cluster 2021-01-27T13:33:50.092195+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:51.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:51 smithi099 bash[9889]: audit 2021-01-27T13:33:50.822722+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:51.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:51 smithi037 bash[9724]: cluster 2021-01-27T13:33:50.092195+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:51.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:51 smithi037 bash[9724]: audit 2021-01-27T13:33:50.822722+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:51.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:51 smithi037 bash[13442]: cluster 2021-01-27T13:33:50.092195+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:51.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:51 smithi037 bash[13442]: audit 2021-01-27T13:33:50.822722+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:33:52.319 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:51 smithi037 bash[24020]: debug 2021-01-27T13:33:51.989+0000 7ff8c450b200 -1 osd.3 0 log_to_monitors {default=true} 2021-01-27T13:33:52.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:51.189007+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:51.194844+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: cephadm 2021-01-27T13:33:51.195808+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:52.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:51.201563+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: cephadm 2021-01-27T13:33:51.202844+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:52.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:51.828747+0000 mgr.y (mgr.14138) 157 : audit [DBG] from='client.34217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:33:52.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:51.830983+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:33:52.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: cephadm 2021-01-27T13:33:51.834094+0000 mgr.y (mgr.14138) 158 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:33:52.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:51.834669+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:33:52.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:51.836422+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:51.838570+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:52.002694+0000 mon.a (mon.0) 364 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T13:33:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[9724]: audit 2021-01-27T13:33:52.003491+0000 mon.b (mon.2) 4 : audit [INF] from='osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T13:33:52.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:51.189007+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:51.194844+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: cephadm 2021-01-27T13:33:51.195808+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:52.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:51.201563+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: cephadm 2021-01-27T13:33:51.202844+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:52.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:51.828747+0000 mgr.y (mgr.14138) 157 : audit [DBG] from='client.34217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:33:52.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:51.830983+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:33:52.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: cephadm 2021-01-27T13:33:51.834094+0000 mgr.y (mgr.14138) 158 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:33:52.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:51.834669+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:33:52.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:51.836422+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:52.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:51.838570+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:52.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:52.002694+0000 mon.a (mon.0) 364 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T13:33:52.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:52 smithi037 bash[13442]: audit 2021-01-27T13:33:52.003491+0000 mon.b (mon.2) 4 : audit [INF] from='osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T13:33:52.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:51.189007+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:51.194844+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: cephadm 2021-01-27T13:33:51.195808+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:52.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:51.201563+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:33:52.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: cephadm 2021-01-27T13:33:51.202844+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:33:52.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:51.828747+0000 mgr.y (mgr.14138) 157 : audit [DBG] from='client.34217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:33:52.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:51.830983+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:33:52.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: cephadm 2021-01-27T13:33:51.834094+0000 mgr.y (mgr.14138) 158 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:33:52.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:51.834669+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:33:52.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:51.836422+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:33:52.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:51.838570+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:33:52.559 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:52.002694+0000 mon.a (mon.0) 364 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T13:33:52.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:52 smithi099 bash[9889]: audit 2021-01-27T13:33:52.003491+0000 mon.b (mon.2) 4 : audit [INF] from='osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T13:33:53.527 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:53 smithi099 bash[9889]: cluster 2021-01-27T13:33:52.092707+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:53.527 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:53 smithi099 bash[9889]: audit 2021-01-27T13:33:52.211811+0000 mon.a (mon.0) 365 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T13:33:53.527 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:53 smithi099 bash[9889]: cluster 2021-01-27T13:33:52.211965+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T13:33:53.528 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:53 smithi099 bash[9889]: audit 2021-01-27T13:33:52.216268+0000 mon.b (mon.2) 5 : audit [INF] from='osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:53.528 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:53 smithi099 bash[9889]: audit 2021-01-27T13:33:52.218214+0000 mon.a (mon.0) 367 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:53.528 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:53 smithi099 bash[9889]: audit 2021-01-27T13:33:52.219065+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:53.570 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[24020]: debug 2021-01-27T13:33:53.217+0000 7ff8baa7c700 -1 osd.3 0 waiting for initial osdmap 2021-01-27T13:33:53.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[9724]: cluster 2021-01-27T13:33:52.092707+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:53.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[9724]: audit 2021-01-27T13:33:52.211811+0000 mon.a (mon.0) 365 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T13:33:53.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[9724]: cluster 2021-01-27T13:33:52.211965+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T13:33:53.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[9724]: audit 2021-01-27T13:33:52.216268+0000 mon.b (mon.2) 5 : audit [INF] from='osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:53.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[9724]: audit 2021-01-27T13:33:52.218214+0000 mon.a (mon.0) 367 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:53.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[9724]: audit 2021-01-27T13:33:52.219065+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:53.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[13442]: cluster 2021-01-27T13:33:52.092707+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:53.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[13442]: audit 2021-01-27T13:33:52.211811+0000 mon.a (mon.0) 365 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T13:33:53.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[13442]: cluster 2021-01-27T13:33:52.211965+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T13:33:53.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[13442]: audit 2021-01-27T13:33:52.216268+0000 mon.b (mon.2) 5 : audit [INF] from='osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:53.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[13442]: audit 2021-01-27T13:33:52.218214+0000 mon.a (mon.0) 367 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2021-01-27T13:33:53.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:53 smithi037 bash[13442]: audit 2021-01-27T13:33:52.219065+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:54.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:54 smithi099 bash[9889]: audit 2021-01-27T13:33:53.216502+0000 mon.a (mon.0) 369 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:33:54.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:54 smithi099 bash[9889]: cluster 2021-01-27T13:33:53.216683+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T13:33:54.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:54 smithi099 bash[9889]: audit 2021-01-27T13:33:53.217588+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:54.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:54 smithi099 bash[9889]: audit 2021-01-27T13:33:53.225355+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:54.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:54 smithi037 bash[9724]: audit 2021-01-27T13:33:53.216502+0000 mon.a (mon.0) 369 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:33:54.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:54 smithi037 bash[9724]: cluster 2021-01-27T13:33:53.216683+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T13:33:54.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:54 smithi037 bash[9724]: audit 2021-01-27T13:33:53.217588+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:54.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:54 smithi037 bash[9724]: audit 2021-01-27T13:33:53.225355+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:54.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:54 smithi037 bash[13442]: audit 2021-01-27T13:33:53.216502+0000 mon.a (mon.0) 369 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2021-01-27T13:33:54.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:54 smithi037 bash[13442]: cluster 2021-01-27T13:33:53.216683+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T13:33:54.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:54 smithi037 bash[13442]: audit 2021-01-27T13:33:53.217588+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:54.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:54 smithi037 bash[13442]: audit 2021-01-27T13:33:53.225355+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:55.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:55 smithi099 bash[9889]: cluster 2021-01-27T13:33:53.032049+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:33:55.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:55 smithi099 bash[9889]: cluster 2021-01-27T13:33:53.032278+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:33:55.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:55 smithi099 bash[9889]: cluster 2021-01-27T13:33:54.093270+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:55.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:55 smithi099 bash[9889]: cluster 2021-01-27T13:33:54.228649+0000 mon.a (mon.0) 373 : cluster [INF] osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695] boot 2021-01-27T13:33:55.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:55 smithi099 bash[9889]: cluster 2021-01-27T13:33:54.228791+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T13:33:55.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:55 smithi099 bash[9889]: audit 2021-01-27T13:33:54.229700+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:55.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[13442]: cluster 2021-01-27T13:33:53.032049+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:33:55.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[13442]: cluster 2021-01-27T13:33:53.032278+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:33:55.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[13442]: cluster 2021-01-27T13:33:54.093270+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:55.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[13442]: cluster 2021-01-27T13:33:54.228649+0000 mon.a (mon.0) 373 : cluster [INF] osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695] boot 2021-01-27T13:33:55.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[13442]: cluster 2021-01-27T13:33:54.228791+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T13:33:55.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[13442]: audit 2021-01-27T13:33:54.229700+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:55.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[9724]: cluster 2021-01-27T13:33:53.032049+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:33:55.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[9724]: cluster 2021-01-27T13:33:53.032278+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:33:55.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[9724]: cluster 2021-01-27T13:33:54.093270+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T13:33:55.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[9724]: cluster 2021-01-27T13:33:54.228649+0000 mon.a (mon.0) 373 : cluster [INF] osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695] boot 2021-01-27T13:33:55.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[9724]: cluster 2021-01-27T13:33:54.228791+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T13:33:55.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:55 smithi037 bash[9724]: audit 2021-01-27T13:33:54.229700+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:33:56.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:56 smithi099 bash[9889]: cluster 2021-01-27T13:33:55.245695+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T13:33:56.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:56 smithi099 bash[9889]: audit 2021-01-27T13:33:55.750781+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]: dispatch 2021-01-27T13:33:56.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:56 smithi099 bash[9889]: audit 2021-01-27T13:33:55.751644+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.15.99:0/192623213' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]: dispatch 2021-01-27T13:33:56.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:56 smithi099 bash[9889]: audit 2021-01-27T13:33:55.759264+0000 mon.a (mon.0) 378 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]': finished 2021-01-27T13:33:56.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:56 smithi099 bash[9889]: cluster 2021-01-27T13:33:55.759419+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T13:33:56.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:56 smithi099 bash[9889]: audit 2021-01-27T13:33:55.759743+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:33:56.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[9724]: cluster 2021-01-27T13:33:55.245695+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T13:33:56.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[9724]: audit 2021-01-27T13:33:55.750781+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]: dispatch 2021-01-27T13:33:56.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[9724]: audit 2021-01-27T13:33:55.751644+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.15.99:0/192623213' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]: dispatch 2021-01-27T13:33:56.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[9724]: audit 2021-01-27T13:33:55.759264+0000 mon.a (mon.0) 378 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]': finished 2021-01-27T13:33:56.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[9724]: cluster 2021-01-27T13:33:55.759419+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T13:33:56.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[9724]: audit 2021-01-27T13:33:55.759743+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:33:56.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[13442]: cluster 2021-01-27T13:33:55.245695+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T13:33:56.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[13442]: audit 2021-01-27T13:33:55.750781+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]: dispatch 2021-01-27T13:33:56.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[13442]: audit 2021-01-27T13:33:55.751644+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.15.99:0/192623213' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]: dispatch 2021-01-27T13:33:56.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[13442]: audit 2021-01-27T13:33:55.759264+0000 mon.a (mon.0) 378 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea105ac4-1f5c-4633-ab72-7f98b4f2b71c"}]': finished 2021-01-27T13:33:56.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[13442]: cluster 2021-01-27T13:33:55.759419+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T13:33:56.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:56 smithi037 bash[13442]: audit 2021-01-27T13:33:55.759743+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:33:57.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:57 smithi099 bash[9889]: cluster 2021-01-27T13:33:56.093851+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:33:57.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:57 smithi099 bash[9889]: audit 2021-01-27T13:33:56.374723+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.15.99:0/3244302702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:57.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:57 smithi037 bash[9724]: cluster 2021-01-27T13:33:56.093851+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:33:57.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:57 smithi037 bash[9724]: audit 2021-01-27T13:33:56.374723+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.15.99:0/3244302702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:57.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:57 smithi037 bash[13442]: cluster 2021-01-27T13:33:56.093851+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:33:57.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:57 smithi037 bash[13442]: audit 2021-01-27T13:33:56.374723+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.15.99:0/3244302702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:33:59.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:33:59 smithi099 bash[9889]: cluster 2021-01-27T13:33:58.094402+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:33:59.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:33:59 smithi037 bash[9724]: cluster 2021-01-27T13:33:58.094402+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:33:59.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:33:59 smithi037 bash[13442]: cluster 2021-01-27T13:33:58.094402+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:00.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:00 smithi099 bash[9889]: audit 2021-01-27T13:33:59.529698+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:00.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:00 smithi037 bash[9724]: audit 2021-01-27T13:33:59.529698+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:00.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:00 smithi037 bash[13442]: audit 2021-01-27T13:33:59.529698+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:01.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:01 smithi099 bash[9889]: cluster 2021-01-27T13:34:00.095063+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:01.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:01 smithi037 bash[9724]: cluster 2021-01-27T13:34:00.095063+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:01.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:01 smithi037 bash[13442]: cluster 2021-01-27T13:34:00.095063+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:03.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:03 smithi099 bash[9889]: cluster 2021-01-27T13:34:02.095746+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:03.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:03 smithi037 bash[9724]: cluster 2021-01-27T13:34:02.095746+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:03.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:03 smithi037 bash[13442]: cluster 2021-01-27T13:34:02.095746+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:04.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:04 smithi099 bash[9889]: audit 2021-01-27T13:34:03.543810+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T13:34:04.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:04 smithi099 bash[9889]: audit 2021-01-27T13:34:03.545714+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:04.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:04 smithi099 bash[9889]: cephadm 2021-01-27T13:34:03.547326+0000 mgr.y (mgr.14138) 165 : cephadm [INF] Deploying daemon osd.4 on smithi099 2021-01-27T13:34:04.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:04 smithi099 bash[9889]: audit 2021-01-27T13:34:03.548330+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T13:34:04.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:04 smithi037 bash[9724]: audit 2021-01-27T13:34:03.543810+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T13:34:04.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:04 smithi037 bash[9724]: audit 2021-01-27T13:34:03.545714+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:04.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:04 smithi037 bash[9724]: cephadm 2021-01-27T13:34:03.547326+0000 mgr.y (mgr.14138) 165 : cephadm [INF] Deploying daemon osd.4 on smithi099 2021-01-27T13:34:04.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:04 smithi037 bash[9724]: audit 2021-01-27T13:34:03.548330+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T13:34:04.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:04 smithi037 bash[13442]: audit 2021-01-27T13:34:03.543810+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T13:34:04.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:04 smithi037 bash[13442]: audit 2021-01-27T13:34:03.545714+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:04.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:04 smithi037 bash[13442]: cephadm 2021-01-27T13:34:03.547326+0000 mgr.y (mgr.14138) 165 : cephadm [INF] Deploying daemon osd.4 on smithi099 2021-01-27T13:34:04.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:04 smithi037 bash[13442]: audit 2021-01-27T13:34:03.548330+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T13:34:05.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:05 smithi099 bash[9889]: cluster 2021-01-27T13:34:04.096371+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:05.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:05 smithi037 bash[9724]: cluster 2021-01-27T13:34:04.096371+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:05.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:05 smithi037 bash[13442]: cluster 2021-01-27T13:34:04.096371+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:06.121 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 4 on host 'smithi099' 2021-01-27T13:34:06.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:06 smithi099 bash[9889]: audit 2021-01-27T13:34:06.110401+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:06.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:06 smithi099 bash[9889]: audit 2021-01-27T13:34:06.117640+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:06.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:06 smithi037 bash[9724]: audit 2021-01-27T13:34:06.110401+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:06.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:06 smithi037 bash[9724]: audit 2021-01-27T13:34:06.117640+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:06.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:06 smithi037 bash[13442]: audit 2021-01-27T13:34:06.110401+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:06.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:06 smithi037 bash[13442]: audit 2021-01-27T13:34:06.117640+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:07.345 DEBUG:teuthology.orchestra.run.smithi099:osd.4> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@osd.4.service 2021-01-27T13:34:07.348 INFO:tasks.cephadm:Deploying osd.5 on smithi099 with /dev/vg_nvme/lv_3... 2021-01-27T13:34:07.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-27T13:34:07.441 INFO:journalctl@ceph.osd.4.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:34:08.277 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:07 smithi099 bash[9889]: cluster 2021-01-27T13:34:06.096967+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:08.277 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:07 smithi099 bash[9889]: cephadm 2021-01-27T13:34:06.109243+0000 mgr.y (mgr.14138) 168 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:34:08.278 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:07 smithi099 bash[9889]: audit 2021-01-27T13:34:06.930720+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:08.278 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:07 smithi099 bash[9889]: audit 2021-01-27T13:34:06.932867+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:08.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:07 smithi037 bash[9724]: cluster 2021-01-27T13:34:06.096967+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:08.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:07 smithi037 bash[9724]: cephadm 2021-01-27T13:34:06.109243+0000 mgr.y (mgr.14138) 168 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:34:08.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:07 smithi037 bash[9724]: audit 2021-01-27T13:34:06.930720+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:08.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:07 smithi037 bash[9724]: audit 2021-01-27T13:34:06.932867+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:08.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:07 smithi037 bash[13442]: cluster 2021-01-27T13:34:06.096967+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:08.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:07 smithi037 bash[13442]: cephadm 2021-01-27T13:34:06.109243+0000 mgr.y (mgr.14138) 168 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:34:08.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:07 smithi037 bash[13442]: audit 2021-01-27T13:34:06.930720+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:08.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:07 smithi037 bash[13442]: audit 2021-01-27T13:34:06.932867+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:09.056 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:08 smithi099 bash[12481]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-27T13:34:09.057 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:08 smithi099 bash[12481]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-01-27T13:34:09.057 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:08 smithi099 bash[12481]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-01-27T13:34:09.057 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:08 smithi099 bash[12481]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-01-27T13:34:09.057 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:08 smithi099 bash[12481]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-27T13:34:09.057 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:08 smithi099 bash[12481]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-27T13:34:09.058 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:08 smithi099 bash[12481]: --> ceph-volume lvm activate successful for osd ID: 4 2021-01-27T13:34:09.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:09 smithi099 bash[9889]: cluster 2021-01-27T13:34:08.097466+0000 mgr.y (mgr.14138) 169 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:09.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:09 smithi037 bash[13442]: cluster 2021-01-27T13:34:08.097466+0000 mgr.y (mgr.14138) 169 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:09.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:09 smithi037 bash[9724]: cluster 2021-01-27T13:34:08.097466+0000 mgr.y (mgr.14138) 169 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:11.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:11 smithi099 bash[9889]: cluster 2021-01-27T13:34:10.098058+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:11.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:11 smithi037 bash[9724]: cluster 2021-01-27T13:34:10.098058+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:11.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:11 smithi037 bash[13442]: cluster 2021-01-27T13:34:10.098058+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:12.915 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 -- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 msgr2=0x558ea9a0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T13:34:12.915 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 -- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 msgr2=0x558ea9a0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T13:34:12.916 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).handle_read_frame_preamble_main r=0 2021-01-27T13:34:12.916 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_MESSAGE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).throttle_message 2021-01-27T13:34:12.916 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_BYTES pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).throttle_bytes 2021-01-27T13:34:12.916 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).throttle_dispatch_queue 2021-01-27T13:34:12.917 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).read_frame_segment seg_idx=0 2021-01-27T13:34:12.917 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).read_frame_segment seg_idx=1 2021-01-27T13:34:12.917 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 -- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 msgr2=0x558ea9a0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T13:34:12.917 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).handle_read_frame_segment r=0 2021-01-27T13:34:12.917 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 -- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 msgr2=0x558ea9a0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T13:34:12.918 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).handle_read_frame_epilogue_main r=0 2021-01-27T13:34:12.918 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 10 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).handle_read_frame_dispatch tag=17 2021-01-27T13:34:12.918 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).handle_message 2021-01-27T13:34:12.918 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 5 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T13:34:12.919 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 5 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).handle_message received message m=0x558ea9a224e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T13:34:12.919 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 -- 172.21.15.99:0/692214622 queue 0x558ea9a224e0 prio 196 2021-01-27T13:34:12.919 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 --2- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 0x558ea9a0d400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x558ea9a1de60 tx=0x558ea9a52d80).read_frame 2021-01-27T13:34:12.919 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01577d700 20 -- 172.21.15.99:0/692214622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558ea9aa0c00 msgr2=0x558ea9a0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T13:34:12.919 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01477b700 1 -- 172.21.15.99:0/692214622 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558ea9a224e0 con 0x558ea9aa0c00 2021-01-27T13:34:12.920 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01477b700 10 -- 172.21.15.99:0/692214622 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T13:34:12.920 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:12 smithi099 bash[12776]: debug 2021-01-27T13:34:12.698+0000 7fa01477b700 20 -- 172.21.15.99:0/692214622 done calling dispatch on 0x558ea9a224e0 2021-01-27T13:34:13.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:13 smithi099 bash[9889]: cluster 2021-01-27T13:34:12.098616+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:13.556 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:13 smithi099 bash[12776]: debug 2021-01-27T13:34:13.234+0000 7fa01c206200 -1 Falling back to public interface 2021-01-27T13:34:13.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:13 smithi037 bash[9724]: cluster 2021-01-27T13:34:12.098616+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:13.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:13 smithi037 bash[13442]: cluster 2021-01-27T13:34:12.098616+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-27T13:34:14.333 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-27T13:34:14.333 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2021-01-27T13:34:14.333 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2021-01-27T13:34:14.333 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.018427 s, 569 MB/s 2021-01-27T13:34:14.334 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2021-01-27T13:34:15.319 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:15 smithi099 bash[9889]: cluster 2021-01-27T13:34:14.099264+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:15.320 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:15 smithi099 bash[9889]: audit 2021-01-27T13:34:14.259780+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:34:15.320 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:15 smithi099 bash[9889]: audit 2021-01-27T13:34:14.262471+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:34:15.385 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2021-01-27T13:34:15.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:15 smithi037 bash[9724]: cluster 2021-01-27T13:34:14.099264+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:15.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:15 smithi037 bash[9724]: audit 2021-01-27T13:34:14.259780+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:34:15.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:15 smithi037 bash[9724]: audit 2021-01-27T13:34:14.262471+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:34:15.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:15 smithi037 bash[13442]: cluster 2021-01-27T13:34:14.099264+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:15.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:15 smithi037 bash[13442]: audit 2021-01-27T13:34:14.259780+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:34:15.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:15 smithi037 bash[13442]: audit 2021-01-27T13:34:14.262471+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:34:16.556 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:16 smithi099 bash[12776]: debug 2021-01-27T13:34:16.242+0000 7fa01c206200 -1 osd.4 0 log_to_monitors {default=true} 2021-01-27T13:34:16.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:16 smithi099 bash[9889]: audit 2021-01-27T13:34:15.483679+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:16.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:16 smithi099 bash[9889]: audit 2021-01-27T13:34:15.852482+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:16 smithi099 bash[9889]: audit 2021-01-27T13:34:15.860369+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:16 smithi099 bash[9889]: cephadm 2021-01-27T13:34:15.862289+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:16.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:16 smithi099 bash[9889]: audit 2021-01-27T13:34:15.870182+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:16 smithi099 bash[9889]: cephadm 2021-01-27T13:34:15.872153+0000 mgr.y (mgr.14138) 174 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:16.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[9724]: audit 2021-01-27T13:34:15.483679+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:16.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[9724]: audit 2021-01-27T13:34:15.852482+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[9724]: audit 2021-01-27T13:34:15.860369+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[9724]: cephadm 2021-01-27T13:34:15.862289+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:16.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[9724]: audit 2021-01-27T13:34:15.870182+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[9724]: cephadm 2021-01-27T13:34:15.872153+0000 mgr.y (mgr.14138) 174 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:16.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[13442]: audit 2021-01-27T13:34:15.483679+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:16.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[13442]: audit 2021-01-27T13:34:15.852482+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[13442]: audit 2021-01-27T13:34:15.860369+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[13442]: cephadm 2021-01-27T13:34:15.862289+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:16.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[13442]: audit 2021-01-27T13:34:15.870182+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:16.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:16 smithi037 bash[13442]: cephadm 2021-01-27T13:34:15.872153+0000 mgr.y (mgr.14138) 174 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:17.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:17 smithi099 bash[9889]: cluster 2021-01-27T13:34:16.099838+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:17.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:17 smithi099 bash[9889]: audit 2021-01-27T13:34:16.250467+0000 mon.a (mon.0) 395 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T13:34:17.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:17 smithi099 bash[9889]: audit 2021-01-27T13:34:16.251375+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T13:34:17.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:17 smithi037 bash[9724]: cluster 2021-01-27T13:34:16.099838+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:17.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:17 smithi037 bash[9724]: audit 2021-01-27T13:34:16.250467+0000 mon.a (mon.0) 395 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T13:34:17.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:17 smithi037 bash[9724]: audit 2021-01-27T13:34:16.251375+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T13:34:17.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:17 smithi037 bash[13442]: cluster 2021-01-27T13:34:16.099838+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:17.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:17 smithi037 bash[13442]: audit 2021-01-27T13:34:16.250467+0000 mon.a (mon.0) 395 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T13:34:17.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:17 smithi037 bash[13442]: audit 2021-01-27T13:34:16.251375+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T13:34:18.555 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:34:18 smithi099 bash[12776]: debug 2021-01-27T13:34:18.190+0000 7fa012777700 -1 osd.4 0 waiting for initial osdmap 2021-01-27T13:34:18.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:18 smithi099 bash[9889]: audit 2021-01-27T13:34:17.181310+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T13:34:18.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:18 smithi099 bash[9889]: cluster 2021-01-27T13:34:17.181445+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T13:34:18.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:18 smithi099 bash[9889]: audit 2021-01-27T13:34:17.181733+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:18.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:18 smithi099 bash[9889]: audit 2021-01-27T13:34:17.183936+0000 mon.a (mon.0) 399 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:18.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:18 smithi099 bash[9889]: audit 2021-01-27T13:34:17.185118+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:18.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[9724]: audit 2021-01-27T13:34:17.181310+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T13:34:18.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[9724]: cluster 2021-01-27T13:34:17.181445+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T13:34:18.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[9724]: audit 2021-01-27T13:34:17.181733+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:18.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[9724]: audit 2021-01-27T13:34:17.183936+0000 mon.a (mon.0) 399 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:18.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[9724]: audit 2021-01-27T13:34:17.185118+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:18.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[13442]: audit 2021-01-27T13:34:17.181310+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T13:34:18.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[13442]: cluster 2021-01-27T13:34:17.181445+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T13:34:18.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[13442]: audit 2021-01-27T13:34:17.181733+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:18.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[13442]: audit 2021-01-27T13:34:17.183936+0000 mon.a (mon.0) 399 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:18.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:18 smithi037 bash[13442]: audit 2021-01-27T13:34:17.185118+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:19.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: cluster 2021-01-27T13:34:18.100359+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:19.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: audit 2021-01-27T13:34:18.186595+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:34:19.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: cluster 2021-01-27T13:34:18.186951+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T13:34:19.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: audit 2021-01-27T13:34:18.188069+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:19.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: audit 2021-01-27T13:34:18.194685+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:19.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: audit 2021-01-27T13:34:18.659159+0000 mgr.y (mgr.14138) 177 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:34:19.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: audit 2021-01-27T13:34:18.661283+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:34:19.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: cephadm 2021-01-27T13:34:18.664243+0000 mgr.y (mgr.14138) 178 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:34:19.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: audit 2021-01-27T13:34:18.664776+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:34:19.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: audit 2021-01-27T13:34:18.666602+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:19.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:19 smithi099 bash[9889]: audit 2021-01-27T13:34:18.668776+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:19.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: cluster 2021-01-27T13:34:18.100359+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:19.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: audit 2021-01-27T13:34:18.186595+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:34:19.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: cluster 2021-01-27T13:34:18.186951+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T13:34:19.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: audit 2021-01-27T13:34:18.188069+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:19.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: audit 2021-01-27T13:34:18.194685+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:19.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: audit 2021-01-27T13:34:18.659159+0000 mgr.y (mgr.14138) 177 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:34:19.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: audit 2021-01-27T13:34:18.661283+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:34:19.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: cephadm 2021-01-27T13:34:18.664243+0000 mgr.y (mgr.14138) 178 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:34:19.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: audit 2021-01-27T13:34:18.664776+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:34:19.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: audit 2021-01-27T13:34:18.666602+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:19.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[9724]: audit 2021-01-27T13:34:18.668776+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:19.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: cluster 2021-01-27T13:34:18.100359+0000 mgr.y (mgr.14138) 176 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:19.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: audit 2021-01-27T13:34:18.186595+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:34:19.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: cluster 2021-01-27T13:34:18.186951+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T13:34:19.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: audit 2021-01-27T13:34:18.188069+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:19.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: audit 2021-01-27T13:34:18.194685+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:19.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: audit 2021-01-27T13:34:18.659159+0000 mgr.y (mgr.14138) 177 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:34:19.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: audit 2021-01-27T13:34:18.661283+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:34:19.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: cephadm 2021-01-27T13:34:18.664243+0000 mgr.y (mgr.14138) 178 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:34:19.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: audit 2021-01-27T13:34:18.664776+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:34:19.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: audit 2021-01-27T13:34:18.666602+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:19.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:19 smithi037 bash[13442]: audit 2021-01-27T13:34:18.668776+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:20.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:20 smithi099 bash[9889]: cluster 2021-01-27T13:34:17.196612+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:34:20.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:20 smithi099 bash[9889]: cluster 2021-01-27T13:34:17.196780+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:34:20.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:20 smithi099 bash[9889]: audit 2021-01-27T13:34:19.195140+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:20.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:20 smithi099 bash[9889]: cluster 2021-01-27T13:34:19.201157+0000 mon.a (mon.0) 409 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:34:20.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:20 smithi099 bash[9889]: cluster 2021-01-27T13:34:19.201291+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T13:34:20.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:20 smithi099 bash[9889]: audit 2021-01-27T13:34:19.202428+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:20.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[13442]: cluster 2021-01-27T13:34:17.196612+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:34:20.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[13442]: cluster 2021-01-27T13:34:17.196780+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:34:20.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[13442]: audit 2021-01-27T13:34:19.195140+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:20.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[13442]: cluster 2021-01-27T13:34:19.201157+0000 mon.a (mon.0) 409 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:34:20.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[13442]: cluster 2021-01-27T13:34:19.201291+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T13:34:20.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[13442]: audit 2021-01-27T13:34:19.202428+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:20.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[9724]: cluster 2021-01-27T13:34:17.196612+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:34:20.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[9724]: cluster 2021-01-27T13:34:17.196780+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:34:20.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[9724]: audit 2021-01-27T13:34:19.195140+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:20.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[9724]: cluster 2021-01-27T13:34:19.201157+0000 mon.a (mon.0) 409 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:34:20.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[9724]: cluster 2021-01-27T13:34:19.201291+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T13:34:20.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:20 smithi037 bash[9724]: audit 2021-01-27T13:34:19.202428+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:34:21.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:21 smithi099 bash[9889]: cluster 2021-01-27T13:34:20.100915+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:21.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:21 smithi099 bash[9889]: cluster 2021-01-27T13:34:20.225262+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T13:34:21.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:21 smithi037 bash[9724]: cluster 2021-01-27T13:34:20.100915+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:21.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:21 smithi037 bash[9724]: cluster 2021-01-27T13:34:20.225262+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T13:34:21.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:21 smithi037 bash[13442]: cluster 2021-01-27T13:34:20.100915+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T13:34:21.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:21 smithi037 bash[13442]: cluster 2021-01-27T13:34:20.225262+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T13:34:23.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:23 smithi099 bash[9889]: cluster 2021-01-27T13:34:22.101576+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:23.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:23 smithi099 bash[9889]: audit 2021-01-27T13:34:22.618410+0000 mon.a (mon.0) 413 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]: dispatch 2021-01-27T13:34:23.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:23 smithi099 bash[9889]: audit 2021-01-27T13:34:22.619402+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.99:0/259259943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]: dispatch 2021-01-27T13:34:23.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:23 smithi099 bash[9889]: audit 2021-01-27T13:34:22.627711+0000 mon.a (mon.0) 414 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]': finished 2021-01-27T13:34:23.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:23 smithi099 bash[9889]: cluster 2021-01-27T13:34:22.627870+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T13:34:23.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:23 smithi099 bash[9889]: audit 2021-01-27T13:34:22.628211+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:23.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[9724]: cluster 2021-01-27T13:34:22.101576+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:23.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[9724]: audit 2021-01-27T13:34:22.618410+0000 mon.a (mon.0) 413 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]: dispatch 2021-01-27T13:34:23.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[9724]: audit 2021-01-27T13:34:22.619402+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.99:0/259259943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]: dispatch 2021-01-27T13:34:23.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[9724]: audit 2021-01-27T13:34:22.627711+0000 mon.a (mon.0) 414 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]': finished 2021-01-27T13:34:23.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[9724]: cluster 2021-01-27T13:34:22.627870+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T13:34:23.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[9724]: audit 2021-01-27T13:34:22.628211+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:23.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[13442]: cluster 2021-01-27T13:34:22.101576+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:23.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[13442]: audit 2021-01-27T13:34:22.618410+0000 mon.a (mon.0) 413 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]: dispatch 2021-01-27T13:34:23.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[13442]: audit 2021-01-27T13:34:22.619402+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.99:0/259259943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]: dispatch 2021-01-27T13:34:23.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[13442]: audit 2021-01-27T13:34:22.627711+0000 mon.a (mon.0) 414 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fc3490c-96bc-4df1-90aa-a4752db114f9"}]': finished 2021-01-27T13:34:23.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[13442]: cluster 2021-01-27T13:34:22.627870+0000 mon.a (mon.0) 415 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T13:34:23.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:23 smithi037 bash[13442]: audit 2021-01-27T13:34:22.628211+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:24.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:24 smithi099 bash[9889]: audit 2021-01-27T13:34:23.270920+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.99:0/1873470316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:34:24.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:24 smithi037 bash[13442]: audit 2021-01-27T13:34:23.270920+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.99:0/1873470316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:34:24.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:24 smithi037 bash[9724]: audit 2021-01-27T13:34:23.270920+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.99:0/1873470316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:34:25.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:25 smithi099 bash[9889]: cluster 2021-01-27T13:34:24.102258+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:25.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:25 smithi037 bash[13442]: cluster 2021-01-27T13:34:24.102258+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:25.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:25 smithi037 bash[9724]: cluster 2021-01-27T13:34:24.102258+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:27.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:27 smithi099 bash[9889]: cluster 2021-01-27T13:34:26.102853+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:27.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:27 smithi099 bash[9889]: audit 2021-01-27T13:34:26.440545+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:27.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:27 smithi037 bash[9724]: cluster 2021-01-27T13:34:26.102853+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:27.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:27 smithi037 bash[9724]: audit 2021-01-27T13:34:26.440545+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:27.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:27 smithi037 bash[13442]: cluster 2021-01-27T13:34:26.102853+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:27.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:27 smithi037 bash[13442]: audit 2021-01-27T13:34:26.440545+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:29.362 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:29 smithi099 bash[9889]: cluster 2021-01-27T13:34:28.103476+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:29.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:29 smithi037 bash[9724]: cluster 2021-01-27T13:34:28.103476+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:29.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:29 smithi037 bash[13442]: cluster 2021-01-27T13:34:28.103476+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:31.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:31 smithi099 bash[9889]: cluster 2021-01-27T13:34:30.104205+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:31.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:31 smithi099 bash[9889]: audit 2021-01-27T13:34:30.557316+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T13:34:31.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:31 smithi099 bash[9889]: audit 2021-01-27T13:34:30.559407+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:31.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:31 smithi099 bash[9889]: cephadm 2021-01-27T13:34:30.561008+0000 mgr.y (mgr.14138) 185 : cephadm [INF] Deploying daemon osd.5 on smithi099 2021-01-27T13:34:31.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:31 smithi099 bash[9889]: audit 2021-01-27T13:34:30.561941+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T13:34:31.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[9724]: cluster 2021-01-27T13:34:30.104205+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:31.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[9724]: audit 2021-01-27T13:34:30.557316+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T13:34:31.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[9724]: audit 2021-01-27T13:34:30.559407+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:31.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[9724]: cephadm 2021-01-27T13:34:30.561008+0000 mgr.y (mgr.14138) 185 : cephadm [INF] Deploying daemon osd.5 on smithi099 2021-01-27T13:34:31.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[9724]: audit 2021-01-27T13:34:30.561941+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T13:34:31.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[13442]: cluster 2021-01-27T13:34:30.104205+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:31.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[13442]: audit 2021-01-27T13:34:30.557316+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T13:34:31.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[13442]: audit 2021-01-27T13:34:30.559407+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:31.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[13442]: cephadm 2021-01-27T13:34:30.561008+0000 mgr.y (mgr.14138) 185 : cephadm [INF] Deploying daemon osd.5 on smithi099 2021-01-27T13:34:31.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:31 smithi037 bash[13442]: audit 2021-01-27T13:34:30.561941+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T13:34:33.089 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 5 on host 'smithi099' 2021-01-27T13:34:33.174 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:33 smithi099 bash[9889]: cluster 2021-01-27T13:34:32.104832+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:33.174 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:33 smithi099 bash[9889]: audit 2021-01-27T13:34:33.086197+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:33.174 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:33 smithi099 bash[9889]: audit 2021-01-27T13:34:33.091416+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:33.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:33 smithi037 bash[9724]: cluster 2021-01-27T13:34:32.104832+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:33.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:33 smithi037 bash[9724]: audit 2021-01-27T13:34:33.086197+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:33.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:33 smithi037 bash[9724]: audit 2021-01-27T13:34:33.091416+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:33.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:33 smithi037 bash[13442]: cluster 2021-01-27T13:34:32.104832+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:33.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:33 smithi037 bash[13442]: audit 2021-01-27T13:34:33.086197+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:33.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:33 smithi037 bash[13442]: audit 2021-01-27T13:34:33.091416+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:34.404 DEBUG:teuthology.orchestra.run.smithi099:osd.5> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@osd.5.service 2021-01-27T13:34:34.407 INFO:tasks.cephadm:Deploying osd.6 on smithi099 with /dev/vg_nvme/lv_2... 2021-01-27T13:34:34.407 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-27T13:34:34.459 INFO:journalctl@ceph.osd.5.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:34:35.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:34 smithi099 bash[9889]: audit 2021-01-27T13:34:33.968328+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:35.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:34 smithi099 bash[9889]: audit 2021-01-27T13:34:33.970703+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:35.319 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:34 smithi037 bash[13442]: audit 2021-01-27T13:34:33.968328+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:35.320 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:34 smithi037 bash[13442]: audit 2021-01-27T13:34:33.970703+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:35.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:34 smithi037 bash[9724]: audit 2021-01-27T13:34:33.968328+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:35.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:34 smithi037 bash[9724]: audit 2021-01-27T13:34:33.970703+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:35.973 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:35 smithi099 bash[14929]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-27T13:34:35.973 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:35 smithi099 bash[14929]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-01-27T13:34:35.973 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:35 smithi099 bash[14929]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-01-27T13:34:35.974 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:35 smithi099 bash[14929]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-01-27T13:34:35.974 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:35 smithi099 bash[14929]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-27T13:34:35.974 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:35 smithi099 bash[14929]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-27T13:34:35.974 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:35 smithi099 bash[14929]: --> ceph-volume lvm activate successful for osd ID: 5 2021-01-27T13:34:36.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:35 smithi099 bash[9889]: cluster 2021-01-27T13:34:34.105435+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:36.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:35 smithi037 bash[9724]: cluster 2021-01-27T13:34:34.105435+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:36.319 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:35 smithi037 bash[13442]: cluster 2021-01-27T13:34:34.105435+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:38.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:37 smithi099 bash[9889]: cluster 2021-01-27T13:34:36.105970+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:38.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:37 smithi037 bash[9724]: cluster 2021-01-27T13:34:36.105970+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:38.319 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:37 smithi037 bash[13442]: cluster 2021-01-27T13:34:36.105970+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:39.553 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[9889]: cluster 2021-01-27T13:34:38.106543+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:39.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:39 smithi037 bash[9724]: cluster 2021-01-27T13:34:38.106543+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:39.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:39 smithi037 bash[13442]: cluster 2021-01-27T13:34:38.106543+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:39.806 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 -- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 msgr2=0x55e76dbf7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T13:34:39.806 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 -- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 msgr2=0x55e76dbf7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T13:34:39.806 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).handle_read_frame_preamble_main r=0 2021-01-27T13:34:39.807 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_MESSAGE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).throttle_message 2021-01-27T13:34:39.807 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_BYTES pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).throttle_bytes 2021-01-27T13:34:39.807 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).throttle_dispatch_queue 2021-01-27T13:34:39.808 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).read_frame_segment seg_idx=0 2021-01-27T13:34:39.808 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).read_frame_segment seg_idx=1 2021-01-27T13:34:39.808 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 -- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 msgr2=0x55e76dbf7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T13:34:39.808 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).handle_read_frame_segment r=0 2021-01-27T13:34:39.809 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 -- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 msgr2=0x55e76dbf7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T13:34:39.809 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).handle_read_frame_epilogue_main r=0 2021-01-27T13:34:39.809 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 10 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).handle_read_frame_dispatch tag=17 2021-01-27T13:34:39.809 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).handle_message 2021-01-27T13:34:39.809 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 5 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T13:34:39.810 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 5 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).handle_message received message m=0x55e76dc0c4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T13:34:39.810 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 -- 172.21.15.99:0/4137551284 queue 0x55e76dc0c4e0 prio 196 2021-01-27T13:34:39.810 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 --2- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 0x55e76dbf7400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x55e76dc07e60 tx=0x55e76dc3cd80).read_frame 2021-01-27T13:34:39.811 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b8f8a700 20 -- 172.21.15.99:0/4137551284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e76dc8ac00 msgr2=0x55e76dbf7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T13:34:39.811 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b7f88700 1 -- 172.21.15.99:0/4137551284 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e76dc0c4e0 con 0x55e76dc8ac00 2021-01-27T13:34:39.811 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b7f88700 10 -- 172.21.15.99:0/4137551284 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T13:34:39.812 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.606+0000 7fa0b7f88700 20 -- 172.21.15.99:0/4137551284 done calling dispatch on 0x55e76dc0c4e0 2021-01-27T13:34:40.159 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:39 smithi099 bash[15271]: debug 2021-01-27T13:34:39.906+0000 7fa0bfa13200 -1 Falling back to public interface 2021-01-27T13:34:40.764 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-27T13:34:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-27T13:34:40.765 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2021-01-27T13:34:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2021-01-27T13:34:40.765 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0189041 s, 555 MB/s 2021-01-27T13:34:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2021-01-27T13:34:41.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:41 smithi099 bash[9889]: cluster 2021-01-27T13:34:40.107164+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:41.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:41 smithi037 bash[9724]: cluster 2021-01-27T13:34:40.107164+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:41.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:41 smithi037 bash[13442]: cluster 2021-01-27T13:34:40.107164+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:41.574 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2021-01-27T13:34:42.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:42 smithi099 bash[9889]: audit 2021-01-27T13:34:42.156337+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:42.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:42 smithi037 bash[9724]: audit 2021-01-27T13:34:42.156337+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:42.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:42 smithi037 bash[13442]: audit 2021-01-27T13:34:42.156337+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:34:43.023 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:42 smithi099 bash[15271]: debug 2021-01-27T13:34:42.934+0000 7fa0bfa13200 -1 osd.5 0 log_to_monitors {default=true} 2021-01-27T13:34:43.805 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: cluster 2021-01-27T13:34:42.107771+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:43.805 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: audit 2021-01-27T13:34:42.523508+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: cephadm 2021-01-27T13:34:42.524878+0000 mgr.y (mgr.14138) 192 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:34:43.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: audit 2021-01-27T13:34:42.939367+0000 mon.a (mon.0) 427 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T13:34:43.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: audit 2021-01-27T13:34:42.940614+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T13:34:43.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: audit 2021-01-27T13:34:42.960697+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: cephadm 2021-01-27T13:34:42.962910+0000 mgr.y (mgr.14138) 193 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:43.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: audit 2021-01-27T13:34:42.971189+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:43 smithi099 bash[9889]: cephadm 2021-01-27T13:34:42.972790+0000 mgr.y (mgr.14138) 194 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:43.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: cluster 2021-01-27T13:34:42.107771+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:43.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: audit 2021-01-27T13:34:42.523508+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: cephadm 2021-01-27T13:34:42.524878+0000 mgr.y (mgr.14138) 192 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:34:43.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: audit 2021-01-27T13:34:42.939367+0000 mon.a (mon.0) 427 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T13:34:43.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: audit 2021-01-27T13:34:42.940614+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T13:34:43.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: audit 2021-01-27T13:34:42.960697+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: cephadm 2021-01-27T13:34:42.962910+0000 mgr.y (mgr.14138) 193 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:43.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: audit 2021-01-27T13:34:42.971189+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[9724]: cephadm 2021-01-27T13:34:42.972790+0000 mgr.y (mgr.14138) 194 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:43.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: cluster 2021-01-27T13:34:42.107771+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:43.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: audit 2021-01-27T13:34:42.523508+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: cephadm 2021-01-27T13:34:42.524878+0000 mgr.y (mgr.14138) 192 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:34:43.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: audit 2021-01-27T13:34:42.939367+0000 mon.a (mon.0) 427 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T13:34:43.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: audit 2021-01-27T13:34:42.940614+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T13:34:43.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: audit 2021-01-27T13:34:42.960697+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: cephadm 2021-01-27T13:34:42.962910+0000 mgr.y (mgr.14138) 193 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:43.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: audit 2021-01-27T13:34:42.971189+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:34:43.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:43 smithi037 bash[13442]: cephadm 2021-01-27T13:34:42.972790+0000 mgr.y (mgr.14138) 194 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:34:44.805 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:34:44 smithi099 bash[15271]: debug 2021-01-27T13:34:44.550+0000 7fa0b5f84700 -1 osd.5 0 waiting for initial osdmap 2021-01-27T13:34:44.805 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:44 smithi099 bash[9889]: audit 2021-01-27T13:34:43.529587+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T13:34:44.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:44 smithi099 bash[9889]: cluster 2021-01-27T13:34:43.529890+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T13:34:44.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:44 smithi099 bash[9889]: audit 2021-01-27T13:34:43.530860+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:44.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:44 smithi099 bash[9889]: audit 2021-01-27T13:34:43.533432+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:44.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:44 smithi099 bash[9889]: audit 2021-01-27T13:34:43.537454+0000 mon.a (mon.0) 433 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:44.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[9724]: audit 2021-01-27T13:34:43.529587+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T13:34:44.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[9724]: cluster 2021-01-27T13:34:43.529890+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T13:34:44.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[9724]: audit 2021-01-27T13:34:43.530860+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:44.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[9724]: audit 2021-01-27T13:34:43.533432+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:44.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[9724]: audit 2021-01-27T13:34:43.537454+0000 mon.a (mon.0) 433 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:44.820 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[13442]: audit 2021-01-27T13:34:43.529587+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T13:34:44.820 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[13442]: cluster 2021-01-27T13:34:43.529890+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T13:34:44.820 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[13442]: audit 2021-01-27T13:34:43.530860+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:44.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[13442]: audit 2021-01-27T13:34:43.533432+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:44.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:44 smithi037 bash[13442]: audit 2021-01-27T13:34:43.537454+0000 mon.a (mon.0) 433 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:34:45.805 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: cluster 2021-01-27T13:34:44.108343+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:45.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: audit 2021-01-27T13:34:44.540570+0000 mon.a (mon.0) 434 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:34:45.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: cluster 2021-01-27T13:34:44.540998+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T13:34:45.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: audit 2021-01-27T13:34:44.542105+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:45.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: audit 2021-01-27T13:34:44.550182+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:45.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: audit 2021-01-27T13:34:44.781302+0000 mgr.y (mgr.14138) 196 : audit [DBG] from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:34:45.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: audit 2021-01-27T13:34:44.783407+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:34:45.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: cephadm 2021-01-27T13:34:44.786218+0000 mgr.y (mgr.14138) 197 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:34:45.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: audit 2021-01-27T13:34:44.786807+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:34:45.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: audit 2021-01-27T13:34:44.788465+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:45.808 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:45 smithi099 bash[9889]: audit 2021-01-27T13:34:44.790647+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:45.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: cluster 2021-01-27T13:34:44.108343+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:45.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: audit 2021-01-27T13:34:44.540570+0000 mon.a (mon.0) 434 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:34:45.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: cluster 2021-01-27T13:34:44.540998+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T13:34:45.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: audit 2021-01-27T13:34:44.542105+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:45.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: audit 2021-01-27T13:34:44.550182+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:45.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: audit 2021-01-27T13:34:44.781302+0000 mgr.y (mgr.14138) 196 : audit [DBG] from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:34:45.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: audit 2021-01-27T13:34:44.783407+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:34:45.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: cephadm 2021-01-27T13:34:44.786218+0000 mgr.y (mgr.14138) 197 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:34:45.827 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: audit 2021-01-27T13:34:44.786807+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:34:45.827 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: audit 2021-01-27T13:34:44.788465+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:45.828 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[9724]: audit 2021-01-27T13:34:44.790647+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:45.828 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: cluster 2021-01-27T13:34:44.108343+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:45.829 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: audit 2021-01-27T13:34:44.540570+0000 mon.a (mon.0) 434 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:34:45.829 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: cluster 2021-01-27T13:34:44.540998+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T13:34:45.830 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: audit 2021-01-27T13:34:44.542105+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:45.830 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: audit 2021-01-27T13:34:44.550182+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:45.831 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: audit 2021-01-27T13:34:44.781302+0000 mgr.y (mgr.14138) 196 : audit [DBG] from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:34:45.831 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: audit 2021-01-27T13:34:44.783407+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:34:45.832 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: cephadm 2021-01-27T13:34:44.786218+0000 mgr.y (mgr.14138) 197 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:34:45.832 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: audit 2021-01-27T13:34:44.786807+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:34:45.833 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: audit 2021-01-27T13:34:44.788465+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:45.833 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:45 smithi037 bash[13442]: audit 2021-01-27T13:34:44.790647+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:46.805 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:46 smithi099 bash[9889]: cluster 2021-01-27T13:34:43.904637+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:34:46.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:46 smithi099 bash[9889]: cluster 2021-01-27T13:34:43.904835+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:34:46.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:46 smithi099 bash[9889]: audit 2021-01-27T13:34:45.556059+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:46.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:46 smithi099 bash[9889]: cluster 2021-01-27T13:34:45.561198+0000 mon.a (mon.0) 443 : cluster [INF] osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921] boot 2021-01-27T13:34:46.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:46 smithi099 bash[9889]: cluster 2021-01-27T13:34:45.561309+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T13:34:46.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:46 smithi099 bash[9889]: audit 2021-01-27T13:34:45.561568+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:46.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[9724]: cluster 2021-01-27T13:34:43.904637+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:34:46.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[9724]: cluster 2021-01-27T13:34:43.904835+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:34:46.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[9724]: audit 2021-01-27T13:34:45.556059+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:46.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[9724]: cluster 2021-01-27T13:34:45.561198+0000 mon.a (mon.0) 443 : cluster [INF] osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921] boot 2021-01-27T13:34:46.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[9724]: cluster 2021-01-27T13:34:45.561309+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T13:34:46.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[9724]: audit 2021-01-27T13:34:45.561568+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:46.820 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[13442]: cluster 2021-01-27T13:34:43.904637+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:34:46.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[13442]: cluster 2021-01-27T13:34:43.904835+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:34:46.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[13442]: audit 2021-01-27T13:34:45.556059+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:46.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[13442]: cluster 2021-01-27T13:34:45.561198+0000 mon.a (mon.0) 443 : cluster [INF] osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921] boot 2021-01-27T13:34:46.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[13442]: cluster 2021-01-27T13:34:45.561309+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T13:34:46.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:46 smithi037 bash[13442]: audit 2021-01-27T13:34:45.561568+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:34:47.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:47 smithi037 bash[9724]: cluster 2021-01-27T13:34:46.108925+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:47.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:47 smithi037 bash[9724]: cluster 2021-01-27T13:34:46.567817+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T13:34:47.819 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:47 smithi037 bash[13442]: cluster 2021-01-27T13:34:46.108925+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:47.819 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:47 smithi037 bash[13442]: cluster 2021-01-27T13:34:46.567817+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T13:34:47.924 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:47 smithi099 bash[9889]: cluster 2021-01-27T13:34:46.108925+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T13:34:47.925 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:47 smithi099 bash[9889]: cluster 2021-01-27T13:34:46.567817+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T13:34:49.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:49 smithi099 bash[9889]: cluster 2021-01-27T13:34:48.109512+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v164: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:49.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:49 smithi099 bash[9889]: audit 2021-01-27T13:34:48.804496+0000 mon.a (mon.0) 447 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]: dispatch 2021-01-27T13:34:49.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:49 smithi099 bash[9889]: audit 2021-01-27T13:34:48.805685+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.99:0/3537638183' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]: dispatch 2021-01-27T13:34:49.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:49 smithi099 bash[9889]: audit 2021-01-27T13:34:48.813672+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]': finished 2021-01-27T13:34:49.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:49 smithi099 bash[9889]: cluster 2021-01-27T13:34:48.813894+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T13:34:49.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:49 smithi099 bash[9889]: audit 2021-01-27T13:34:48.814212+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:34:49.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[9724]: cluster 2021-01-27T13:34:48.109512+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v164: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:49.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[9724]: audit 2021-01-27T13:34:48.804496+0000 mon.a (mon.0) 447 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]: dispatch 2021-01-27T13:34:49.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[9724]: audit 2021-01-27T13:34:48.805685+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.99:0/3537638183' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]: dispatch 2021-01-27T13:34:49.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[9724]: audit 2021-01-27T13:34:48.813672+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]': finished 2021-01-27T13:34:49.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[9724]: cluster 2021-01-27T13:34:48.813894+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T13:34:49.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[9724]: audit 2021-01-27T13:34:48.814212+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:34:49.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[13442]: cluster 2021-01-27T13:34:48.109512+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v164: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:49.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[13442]: audit 2021-01-27T13:34:48.804496+0000 mon.a (mon.0) 447 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]: dispatch 2021-01-27T13:34:49.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[13442]: audit 2021-01-27T13:34:48.805685+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.99:0/3537638183' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]: dispatch 2021-01-27T13:34:49.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[13442]: audit 2021-01-27T13:34:48.813672+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99cbcbe8-43df-4778-ab84-4605193bd31c"}]': finished 2021-01-27T13:34:49.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[13442]: cluster 2021-01-27T13:34:48.813894+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T13:34:49.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:49 smithi037 bash[13442]: audit 2021-01-27T13:34:48.814212+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:34:50.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:50 smithi099 bash[9889]: audit 2021-01-27T13:34:49.468532+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.99:0/3214492055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:34:50.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:50 smithi037 bash[9724]: audit 2021-01-27T13:34:49.468532+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.99:0/3214492055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:34:50.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:50 smithi037 bash[13442]: audit 2021-01-27T13:34:49.468532+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.99:0/3214492055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:34:51.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:51 smithi099 bash[9889]: cluster 2021-01-27T13:34:50.110182+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:51.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:51 smithi037 bash[9724]: cluster 2021-01-27T13:34:50.110182+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:51.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:51 smithi037 bash[13442]: cluster 2021-01-27T13:34:50.110182+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:53.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:53 smithi099 bash[9889]: cluster 2021-01-27T13:34:52.110814+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:53.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:53 smithi099 bash[9889]: audit 2021-01-27T13:34:52.613224+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:53.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:53 smithi037 bash[9724]: cluster 2021-01-27T13:34:52.110814+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:53.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:53 smithi037 bash[9724]: audit 2021-01-27T13:34:52.613224+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:53.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:53 smithi037 bash[13442]: cluster 2021-01-27T13:34:52.110814+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:53.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:53 smithi037 bash[13442]: audit 2021-01-27T13:34:52.613224+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:34:55.498 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:55 smithi099 bash[9889]: cluster 2021-01-27T13:34:54.111404+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:55.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:55 smithi037 bash[9724]: cluster 2021-01-27T13:34:54.111404+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:55.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:55 smithi037 bash[13442]: cluster 2021-01-27T13:34:54.111404+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:57.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:57 smithi099 bash[9889]: cluster 2021-01-27T13:34:56.112019+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:57.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:57 smithi099 bash[9889]: audit 2021-01-27T13:34:56.743388+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T13:34:57.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:57 smithi099 bash[9889]: audit 2021-01-27T13:34:56.745299+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:57.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:57 smithi099 bash[9889]: cephadm 2021-01-27T13:34:56.746834+0000 mgr.y (mgr.14138) 204 : cephadm [INF] Deploying daemon osd.6 on smithi099 2021-01-27T13:34:57.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:57 smithi099 bash[9889]: audit 2021-01-27T13:34:56.747761+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T13:34:57.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[9724]: cluster 2021-01-27T13:34:56.112019+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:57.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[9724]: audit 2021-01-27T13:34:56.743388+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T13:34:57.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[9724]: audit 2021-01-27T13:34:56.745299+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:57.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[9724]: cephadm 2021-01-27T13:34:56.746834+0000 mgr.y (mgr.14138) 204 : cephadm [INF] Deploying daemon osd.6 on smithi099 2021-01-27T13:34:57.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[9724]: audit 2021-01-27T13:34:56.747761+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T13:34:57.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[13442]: cluster 2021-01-27T13:34:56.112019+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:57.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[13442]: audit 2021-01-27T13:34:56.743388+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T13:34:57.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[13442]: audit 2021-01-27T13:34:56.745299+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:34:57.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[13442]: cephadm 2021-01-27T13:34:56.746834+0000 mgr.y (mgr.14138) 204 : cephadm [INF] Deploying daemon osd.6 on smithi099 2021-01-27T13:34:57.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:57 smithi037 bash[13442]: audit 2021-01-27T13:34:56.747761+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T13:34:59.215 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 6 on host 'smithi099' 2021-01-27T13:34:59.301 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:34:59 smithi099 bash[9889]: cluster 2021-01-27T13:34:58.112608+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:59.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:34:59 smithi037 bash[9724]: cluster 2021-01-27T13:34:58.112608+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:34:59.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:34:59 smithi037 bash[13442]: cluster 2021-01-27T13:34:58.112608+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:00.530 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:00 smithi099 bash[9889]: audit 2021-01-27T13:34:59.209730+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:00.531 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:00 smithi099 bash[9889]: audit 2021-01-27T13:34:59.214679+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:00.531 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:00 smithi099 bash[9889]: audit 2021-01-27T13:34:59.248687+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:00.532 DEBUG:teuthology.orchestra.run.smithi099:osd.6> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@osd.6.service 2021-01-27T13:35:00.535 INFO:tasks.cephadm:Deploying osd.7 on smithi099 with /dev/vg_nvme/lv_1... 2021-01-27T13:35:00.535 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-27T13:35:00.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:00 smithi037 bash[9724]: audit 2021-01-27T13:34:59.209730+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:00.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:00 smithi037 bash[9724]: audit 2021-01-27T13:34:59.214679+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:00.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:00 smithi037 bash[9724]: audit 2021-01-27T13:34:59.248687+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:00.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:00 smithi037 bash[13442]: audit 2021-01-27T13:34:59.209730+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:00.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:00 smithi037 bash[13442]: audit 2021-01-27T13:34:59.214679+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:00.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:00 smithi037 bash[13442]: audit 2021-01-27T13:34:59.248687+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:00.644 INFO:journalctl@ceph.osd.6.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:35:01.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[9889]: cluster 2021-01-27T13:35:00.113168+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:01.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[9889]: audit 2021-01-27T13:35:00.158823+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:01.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[9889]: audit 2021-01-27T13:35:00.160730+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:01.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:01 smithi037 bash[9724]: cluster 2021-01-27T13:35:00.113168+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:01.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:01 smithi037 bash[9724]: audit 2021-01-27T13:35:00.158823+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:01.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:01 smithi037 bash[9724]: audit 2021-01-27T13:35:00.160730+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:01.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:01 smithi037 bash[13442]: cluster 2021-01-27T13:35:00.113168+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:01.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:01 smithi037 bash[13442]: audit 2021-01-27T13:35:00.158823+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:01.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:01 smithi037 bash[13442]: audit 2021-01-27T13:35:00.160730+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:02.202 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[17419]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-27T13:35:02.202 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[17419]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-01-27T13:35:02.202 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[17419]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-01-27T13:35:02.203 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[17419]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-01-27T13:35:02.203 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[17419]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-27T13:35:02.203 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[17419]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-27T13:35:02.203 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:01 smithi099 bash[17419]: --> ceph-volume lvm activate successful for osd ID: 6 2021-01-27T13:35:03.304 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:03 smithi099 bash[9889]: cluster 2021-01-27T13:35:02.113826+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:03.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:03 smithi037 bash[9724]: cluster 2021-01-27T13:35:02.113826+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:03.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:03 smithi037 bash[13442]: cluster 2021-01-27T13:35:02.113826+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:05.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[9889]: cluster 2021-01-27T13:35:04.114444+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:05.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:05 smithi037 bash[9724]: cluster 2021-01-27T13:35:04.114444+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:05.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:05 smithi037 bash[13442]: cluster 2021-01-27T13:35:04.114444+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:05.805 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 -- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 msgr2=0x557900e25e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T13:35:05.805 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 -- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 msgr2=0x557900e25e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T13:35:05.806 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).handle_read_frame_preamble_main r=0 2021-01-27T13:35:05.806 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_MESSAGE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).throttle_message 2021-01-27T13:35:05.806 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_BYTES pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).throttle_bytes 2021-01-27T13:35:05.806 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).throttle_dispatch_queue 2021-01-27T13:35:05.806 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).read_frame_segment seg_idx=0 2021-01-27T13:35:05.807 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).read_frame_segment seg_idx=1 2021-01-27T13:35:05.807 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 -- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 msgr2=0x557900e25e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T13:35:05.807 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).handle_read_frame_segment r=0 2021-01-27T13:35:05.807 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 -- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 msgr2=0x557900e25e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T13:35:05.807 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).handle_read_frame_epilogue_main r=0 2021-01-27T13:35:05.808 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 10 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).handle_read_frame_dispatch tag=17 2021-01-27T13:35:05.808 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).handle_message 2021-01-27T13:35:05.808 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 5 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T13:35:05.808 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 5 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).handle_message received message m=0x557900e3a4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T13:35:05.809 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 -- 172.21.15.99:0/464800430 queue 0x557900e3a4e0 prio 196 2021-01-27T13:35:05.809 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 --2- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 0x557900e25e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x557900e35e60 tx=0x557900e6a0c0).read_frame 2021-01-27T13:35:05.809 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5165776700 20 -- 172.21.15.99:0/464800430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557900eb9000 msgr2=0x557900e25e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T13:35:05.809 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5164f75700 1 -- 172.21.15.99:0/464800430 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557900e3a4e0 con 0x557900eb9000 2021-01-27T13:35:05.809 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5164f75700 10 -- 172.21.15.99:0/464800430 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T13:35:05.810 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:05 smithi099 bash[17780]: debug 2021-01-27T13:35:05.474+0000 7f5164f75700 20 -- 172.21.15.99:0/464800430 done calling dispatch on 0x557900e3a4e0 2021-01-27T13:35:06.305 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:06 smithi099 bash[17780]: debug 2021-01-27T13:35:06.022+0000 7f516ca00200 -1 Falling back to public interface 2021-01-27T13:35:07.047 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-27T13:35:07.048 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-27T13:35:07.048 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2021-01-27T13:35:07.048 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2021-01-27T13:35:07.048 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0164103 s, 639 MB/s 2021-01-27T13:35:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2021-01-27T13:35:07.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:07 smithi099 bash[9889]: cluster 2021-01-27T13:35:06.115044+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:07.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:07 smithi037 bash[9724]: cluster 2021-01-27T13:35:06.115044+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:07.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:07 smithi037 bash[13442]: cluster 2021-01-27T13:35:06.115044+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:07.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi099:vg_nvme/lv_1 2021-01-27T13:35:09.086 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:08 smithi099 bash[17780]: debug 2021-01-27T13:35:08.834+0000 7f516ca00200 -1 osd.6 0 log_to_monitors {default=true} 2021-01-27T13:35:09.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:09 smithi099 bash[9889]: cluster 2021-01-27T13:35:08.115625+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:09.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:09 smithi099 bash[9889]: audit 2021-01-27T13:35:08.562607+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:09.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:09 smithi099 bash[9889]: audit 2021-01-27T13:35:08.841251+0000 mon.a (mon.0) 461 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T13:35:09.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:09 smithi099 bash[9889]: audit 2021-01-27T13:35:08.842684+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T13:35:09.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:09 smithi099 bash[9889]: audit 2021-01-27T13:35:08.940207+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:09.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:09 smithi099 bash[9889]: audit 2021-01-27T13:35:08.965464+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:09.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:09 smithi099 bash[9889]: cephadm 2021-01-27T13:35:08.967148+0000 mgr.y (mgr.14138) 211 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:09.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:09 smithi099 bash[9889]: cephadm 2021-01-27T13:35:08.970993+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:35:09.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[9724]: cluster 2021-01-27T13:35:08.115625+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:09.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[9724]: audit 2021-01-27T13:35:08.562607+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:09.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[9724]: audit 2021-01-27T13:35:08.841251+0000 mon.a (mon.0) 461 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T13:35:09.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[9724]: audit 2021-01-27T13:35:08.842684+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T13:35:09.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[9724]: audit 2021-01-27T13:35:08.940207+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:09.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[9724]: audit 2021-01-27T13:35:08.965464+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:09.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[9724]: cephadm 2021-01-27T13:35:08.967148+0000 mgr.y (mgr.14138) 211 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:09.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[9724]: cephadm 2021-01-27T13:35:08.970993+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:35:09.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[13442]: cluster 2021-01-27T13:35:08.115625+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:09.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[13442]: audit 2021-01-27T13:35:08.562607+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:09.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[13442]: audit 2021-01-27T13:35:08.841251+0000 mon.a (mon.0) 461 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T13:35:09.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[13442]: audit 2021-01-27T13:35:08.842684+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T13:35:09.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[13442]: audit 2021-01-27T13:35:08.940207+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:09.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[13442]: audit 2021-01-27T13:35:08.965464+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:09.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[13442]: cephadm 2021-01-27T13:35:08.967148+0000 mgr.y (mgr.14138) 211 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:09.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:09 smithi037 bash[13442]: cephadm 2021-01-27T13:35:08.970993+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:35:10.304 INFO:journalctl@ceph.osd.6.smithi099.stdout:Jan 27 13:35:10 smithi099 bash[17780]: debug 2021-01-27T13:35:10.134+0000 7f5162f71700 -1 osd.6 0 waiting for initial osdmap 2021-01-27T13:35:10.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:10 smithi099 bash[9889]: audit 2021-01-27T13:35:09.119477+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T13:35:10.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:10 smithi099 bash[9889]: cluster 2021-01-27T13:35:09.119580+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T13:35:10.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:10 smithi099 bash[9889]: audit 2021-01-27T13:35:09.120960+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:10.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:10 smithi099 bash[9889]: audit 2021-01-27T13:35:09.123616+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:10.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:10 smithi099 bash[9889]: audit 2021-01-27T13:35:09.125028+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:10.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:10 smithi099 bash[9889]: audit 2021-01-27T13:35:09.382769+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:10.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:10 smithi099 bash[9889]: cephadm 2021-01-27T13:35:09.383808+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:10.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[9724]: audit 2021-01-27T13:35:09.119477+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T13:35:10.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[9724]: cluster 2021-01-27T13:35:09.119580+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T13:35:10.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[9724]: audit 2021-01-27T13:35:09.120960+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:10.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[9724]: audit 2021-01-27T13:35:09.123616+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:10.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[9724]: audit 2021-01-27T13:35:09.125028+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:10.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[9724]: audit 2021-01-27T13:35:09.382769+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:10.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[9724]: cephadm 2021-01-27T13:35:09.383808+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:10.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[13442]: audit 2021-01-27T13:35:09.119477+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T13:35:10.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[13442]: cluster 2021-01-27T13:35:09.119580+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T13:35:10.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[13442]: audit 2021-01-27T13:35:09.120960+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:10.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[13442]: audit 2021-01-27T13:35:09.123616+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:10.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[13442]: audit 2021-01-27T13:35:09.125028+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:10.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[13442]: audit 2021-01-27T13:35:09.382769+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:10.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:10 smithi037 bash[13442]: cephadm 2021-01-27T13:35:09.383808+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:11.502 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:11 smithi099 bash[9889]: cluster 2021-01-27T13:35:10.116230+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:11.502 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:11 smithi099 bash[9889]: audit 2021-01-27T13:35:10.124571+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:35:11.503 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:11 smithi099 bash[9889]: cluster 2021-01-27T13:35:10.125389+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T13:35:11.503 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:11 smithi099 bash[9889]: audit 2021-01-27T13:35:10.126946+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:11.503 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:11 smithi099 bash[9889]: audit 2021-01-27T13:35:10.135860+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:11.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[9724]: cluster 2021-01-27T13:35:10.116230+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:11.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[9724]: audit 2021-01-27T13:35:10.124571+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:35:11.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[9724]: cluster 2021-01-27T13:35:10.125389+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T13:35:11.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[9724]: audit 2021-01-27T13:35:10.126946+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:11.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[9724]: audit 2021-01-27T13:35:10.135860+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:11.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[13442]: cluster 2021-01-27T13:35:10.116230+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T13:35:11.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[13442]: audit 2021-01-27T13:35:10.124571+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:35:11.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[13442]: cluster 2021-01-27T13:35:10.125389+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T13:35:11.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[13442]: audit 2021-01-27T13:35:10.126946+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:11.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:11 smithi037 bash[13442]: audit 2021-01-27T13:35:10.135860+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:12.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: cluster 2021-01-27T13:35:09.799472+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:35:12.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: cluster 2021-01-27T13:35:09.799724+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:35:12.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: cluster 2021-01-27T13:35:11.127706+0000 mon.a (mon.0) 473 : cluster [INF] osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874] boot 2021-01-27T13:35:12.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: cluster 2021-01-27T13:35:11.127937+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T13:35:12.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: audit 2021-01-27T13:35:11.128299+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:12.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: audit 2021-01-27T13:35:11.141277+0000 mgr.y (mgr.14138) 215 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:35:12.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: audit 2021-01-27T13:35:11.142559+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:35:12.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: cephadm 2021-01-27T13:35:11.144285+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:35:12.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: audit 2021-01-27T13:35:11.144637+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:35:12.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: audit 2021-01-27T13:35:11.145686+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:12.557 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:12 smithi099 bash[9889]: audit 2021-01-27T13:35:11.146992+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:12.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: cluster 2021-01-27T13:35:09.799472+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:35:12.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: cluster 2021-01-27T13:35:09.799724+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:35:12.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: cluster 2021-01-27T13:35:11.127706+0000 mon.a (mon.0) 473 : cluster [INF] osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874] boot 2021-01-27T13:35:12.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: cluster 2021-01-27T13:35:11.127937+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T13:35:12.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: audit 2021-01-27T13:35:11.128299+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:12.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: audit 2021-01-27T13:35:11.141277+0000 mgr.y (mgr.14138) 215 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:35:12.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: audit 2021-01-27T13:35:11.142559+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:35:12.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: cephadm 2021-01-27T13:35:11.144285+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:35:12.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: audit 2021-01-27T13:35:11.144637+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:35:12.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: audit 2021-01-27T13:35:11.145686+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:12.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[9724]: audit 2021-01-27T13:35:11.146992+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:12.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: cluster 2021-01-27T13:35:09.799472+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:35:12.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: cluster 2021-01-27T13:35:09.799724+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:35:12.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: cluster 2021-01-27T13:35:11.127706+0000 mon.a (mon.0) 473 : cluster [INF] osd.6 [v2:172.21.15.99:6816/2481050874,v1:172.21.15.99:6817/2481050874] boot 2021-01-27T13:35:12.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: cluster 2021-01-27T13:35:11.127937+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T13:35:12.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: audit 2021-01-27T13:35:11.128299+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T13:35:12.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: audit 2021-01-27T13:35:11.141277+0000 mgr.y (mgr.14138) 215 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:35:12.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: audit 2021-01-27T13:35:11.142559+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T13:35:12.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: cephadm 2021-01-27T13:35:11.144285+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Applying drive group None on host smithi099... 2021-01-27T13:35:12.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: audit 2021-01-27T13:35:11.144637+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T13:35:12.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: audit 2021-01-27T13:35:11.145686+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:12.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:12 smithi037 bash[13442]: audit 2021-01-27T13:35:11.146992+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:13.304 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:13 smithi099 bash[9889]: cluster 2021-01-27T13:35:12.116980+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:13.304 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:13 smithi099 bash[9889]: cluster 2021-01-27T13:35:12.150363+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T13:35:13.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:13 smithi037 bash[9724]: cluster 2021-01-27T13:35:12.116980+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:13.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:13 smithi037 bash[9724]: cluster 2021-01-27T13:35:12.150363+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T13:35:13.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:13 smithi037 bash[13442]: cluster 2021-01-27T13:35:12.116980+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:13.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:13 smithi037 bash[13442]: cluster 2021-01-27T13:35:12.150363+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T13:35:15.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:15 smithi099 bash[9889]: cluster 2021-01-27T13:35:14.117627+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:15.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:15 smithi099 bash[9889]: audit 2021-01-27T13:35:14.262413+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:35:15.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:15 smithi099 bash[9889]: audit 2021-01-27T13:35:14.265457+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:35:15.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:15 smithi099 bash[9889]: audit 2021-01-27T13:35:15.136920+0000 mon.a (mon.0) 483 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]: dispatch 2021-01-27T13:35:15.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:15 smithi099 bash[9889]: audit 2021-01-27T13:35:15.138319+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.99:0/955578817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]: dispatch 2021-01-27T13:35:15.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:15 smithi099 bash[9889]: audit 2021-01-27T13:35:15.147902+0000 mon.a (mon.0) 484 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]': finished 2021-01-27T13:35:15.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:15 smithi099 bash[9889]: cluster 2021-01-27T13:35:15.148188+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T13:35:15.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:15 smithi099 bash[9889]: audit 2021-01-27T13:35:15.148468+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:15.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[9724]: cluster 2021-01-27T13:35:14.117627+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:15.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[9724]: audit 2021-01-27T13:35:14.262413+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:35:15.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[9724]: audit 2021-01-27T13:35:14.265457+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:35:15.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[9724]: audit 2021-01-27T13:35:15.136920+0000 mon.a (mon.0) 483 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]: dispatch 2021-01-27T13:35:15.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[9724]: audit 2021-01-27T13:35:15.138319+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.99:0/955578817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]: dispatch 2021-01-27T13:35:15.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[9724]: audit 2021-01-27T13:35:15.147902+0000 mon.a (mon.0) 484 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]': finished 2021-01-27T13:35:15.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[9724]: cluster 2021-01-27T13:35:15.148188+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T13:35:15.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[9724]: audit 2021-01-27T13:35:15.148468+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:15.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[13442]: cluster 2021-01-27T13:35:14.117627+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:15.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[13442]: audit 2021-01-27T13:35:14.262413+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:35:15.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[13442]: audit 2021-01-27T13:35:14.265457+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:35:15.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[13442]: audit 2021-01-27T13:35:15.136920+0000 mon.a (mon.0) 483 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]: dispatch 2021-01-27T13:35:15.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[13442]: audit 2021-01-27T13:35:15.138319+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.99:0/955578817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]: dispatch 2021-01-27T13:35:15.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[13442]: audit 2021-01-27T13:35:15.147902+0000 mon.a (mon.0) 484 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d497a0c5-50a0-45b0-83e6-1058a44038c3"}]': finished 2021-01-27T13:35:15.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[13442]: cluster 2021-01-27T13:35:15.148188+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T13:35:15.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:15 smithi037 bash[13442]: audit 2021-01-27T13:35:15.148468+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:16.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:16 smithi099 bash[9889]: audit 2021-01-27T13:35:15.836281+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.15.99:0/228178318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:35:16.568 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:16 smithi037 bash[13442]: audit 2021-01-27T13:35:15.836281+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.15.99:0/228178318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:35:16.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:16 smithi037 bash[9724]: audit 2021-01-27T13:35:15.836281+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.15.99:0/228178318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T13:35:17.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:17 smithi099 bash[9889]: cluster 2021-01-27T13:35:16.118221+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:17.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:17 smithi037 bash[9724]: cluster 2021-01-27T13:35:16.118221+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:17.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:17 smithi037 bash[13442]: cluster 2021-01-27T13:35:16.118221+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:19.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:19 smithi099 bash[9889]: cluster 2021-01-27T13:35:18.118934+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:19.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:19 smithi099 bash[9889]: audit 2021-01-27T13:35:18.932447+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:19.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:19 smithi037 bash[9724]: cluster 2021-01-27T13:35:18.118934+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:19.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:19 smithi037 bash[9724]: audit 2021-01-27T13:35:18.932447+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:19.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:19 smithi037 bash[13442]: cluster 2021-01-27T13:35:18.118934+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:19.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:19 smithi037 bash[13442]: audit 2021-01-27T13:35:18.932447+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:21.304 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:21 smithi099 bash[9889]: cluster 2021-01-27T13:35:20.119533+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:21.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:21 smithi037 bash[9724]: cluster 2021-01-27T13:35:20.119533+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:21.568 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:21 smithi037 bash[13442]: cluster 2021-01-27T13:35:20.119533+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:23.546 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:23 smithi099 bash[9889]: cluster 2021-01-27T13:35:22.120195+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:23.546 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:23 smithi099 bash[9889]: audit 2021-01-27T13:35:23.146244+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T13:35:23.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:23 smithi099 bash[9889]: audit 2021-01-27T13:35:23.148258+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:23.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:23 smithi099 bash[9889]: audit 2021-01-27T13:35:23.150650+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T13:35:23.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:23 smithi037 bash[9724]: cluster 2021-01-27T13:35:22.120195+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:23.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:23 smithi037 bash[9724]: audit 2021-01-27T13:35:23.146244+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T13:35:23.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:23 smithi037 bash[9724]: audit 2021-01-27T13:35:23.148258+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:23.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:23 smithi037 bash[9724]: audit 2021-01-27T13:35:23.150650+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T13:35:23.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:23 smithi037 bash[13442]: cluster 2021-01-27T13:35:22.120195+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:23.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:23 smithi037 bash[13442]: audit 2021-01-27T13:35:23.146244+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T13:35:23.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:23 smithi037 bash[13442]: audit 2021-01-27T13:35:23.148258+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:23.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:23 smithi037 bash[13442]: audit 2021-01-27T13:35:23.150650+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T13:35:24.533 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:24 smithi099 bash[9889]: cephadm 2021-01-27T13:35:23.149741+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Deploying daemon osd.7 on smithi099 2021-01-27T13:35:24.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:24 smithi037 bash[9724]: cephadm 2021-01-27T13:35:23.149741+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Deploying daemon osd.7 on smithi099 2021-01-27T13:35:24.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:24 smithi037 bash[13442]: cephadm 2021-01-27T13:35:23.149741+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Deploying daemon osd.7 on smithi099 2021-01-27T13:35:25.449 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:25 smithi099 bash[9889]: cluster 2021-01-27T13:35:24.120847+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:25.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:25 smithi037 bash[9724]: cluster 2021-01-27T13:35:24.120847+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:25.568 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:25 smithi037 bash[13442]: cluster 2021-01-27T13:35:24.120847+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:25.853 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 7 on host 'smithi099' 2021-01-27T13:35:26.441 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:26 smithi099 bash[9889]: audit 2021-01-27T13:35:25.848931+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:26.441 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:26 smithi099 bash[9889]: audit 2021-01-27T13:35:25.853984+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:26.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:26 smithi037 bash[9724]: audit 2021-01-27T13:35:25.848931+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:26.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:26 smithi037 bash[9724]: audit 2021-01-27T13:35:25.853984+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:26.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:26 smithi037 bash[13442]: audit 2021-01-27T13:35:25.848931+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:26.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:26 smithi037 bash[13442]: audit 2021-01-27T13:35:25.853984+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:27.212 DEBUG:teuthology.orchestra.run.smithi099:osd.7> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@osd.7.service 2021-01-27T13:35:27.214 INFO:tasks.cephadm:Adding ceph.rgw.realm.zone.a on smithi037 2021-01-27T13:35:27.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- radosgw-admin realm create --rgw-realm realm --default 2021-01-27T13:35:27.236 INFO:journalctl@ceph.osd.7.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:35:28.304 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:27 smithi099 bash[9889]: cluster 2021-01-27T13:35:26.121461+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:28.304 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:27 smithi099 bash[9889]: audit 2021-01-27T13:35:26.971551+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:28.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:27 smithi099 bash[9889]: audit 2021-01-27T13:35:26.973810+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:28.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:27 smithi037 bash[9724]: cluster 2021-01-27T13:35:26.121461+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:28.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:27 smithi037 bash[9724]: audit 2021-01-27T13:35:26.971551+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:28.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:27 smithi037 bash[9724]: audit 2021-01-27T13:35:26.973810+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:28.319 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:27 smithi037 bash[13442]: cluster 2021-01-27T13:35:26.121461+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:28.319 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:27 smithi037 bash[13442]: audit 2021-01-27T13:35:26.971551+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:28.320 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:27 smithi037 bash[13442]: audit 2021-01-27T13:35:26.973810+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T13:35:28.804 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:28 smithi099 bash[19913]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-27T13:35:28.804 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:28 smithi099 bash[19913]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-01-27T13:35:28.805 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:28 smithi099 bash[19913]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-01-27T13:35:28.805 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:28 smithi099 bash[19913]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-01-27T13:35:28.805 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:28 smithi099 bash[19913]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-27T13:35:28.805 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:28 smithi099 bash[19913]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-27T13:35:28.805 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:28 smithi099 bash[19913]: --> ceph-volume lvm activate successful for osd ID: 7 2021-01-27T13:35:29.523 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:29 smithi099 bash[9889]: cluster 2021-01-27T13:35:28.122039+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:29.568 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:29 smithi037 bash[13442]: cluster 2021-01-27T13:35:28.122039+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:29.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:29 smithi037 bash[9724]: cluster 2021-01-27T13:35:28.122039+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:30.554 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:30 smithi099 bash[9889]: audit 2021-01-27T13:35:29.257114+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:30.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:30 smithi037 bash[9724]: audit 2021-01-27T13:35:29.257114+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:30.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:30 smithi037 bash[13442]: audit 2021-01-27T13:35:29.257114+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:31.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:31 smithi037 bash[9724]: cluster 2021-01-27T13:35:30.122726+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:31.569 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:31 smithi037 bash[13442]: cluster 2021-01-27T13:35:30.122726+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:31.621 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[9889]: cluster 2021-01-27T13:35:30.122726+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:32.304 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 -- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 msgr2=0x5644167e1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T13:35:32.405 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 -- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 msgr2=0x5644167e1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T13:35:32.406 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).handle_read_frame_preamble_main r=0 2021-01-27T13:35:32.406 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_MESSAGE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).throttle_message 2021-01-27T13:35:32.406 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_BYTES pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).throttle_bytes 2021-01-27T13:35:32.406 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).throttle_dispatch_queue 2021-01-27T13:35:32.407 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).read_frame_segment seg_idx=0 2021-01-27T13:35:32.407 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).read_frame_segment seg_idx=1 2021-01-27T13:35:32.407 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 -- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 msgr2=0x5644167e1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T13:35:32.407 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).handle_read_frame_segment r=0 2021-01-27T13:35:32.408 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 -- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 msgr2=0x5644167e1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T13:35:32.408 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).handle_read_frame_epilogue_main r=0 2021-01-27T13:35:32.408 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 10 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).handle_read_frame_dispatch tag=17 2021-01-27T13:35:32.408 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).handle_message 2021-01-27T13:35:32.408 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 5 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T13:35:32.409 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 5 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).handle_message received message m=0x5644167f64e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T13:35:32.409 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 -- 172.21.15.99:0/2004198298 queue 0x5644167f64e0 prio 196 2021-01-27T13:35:32.409 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 --2- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 0x5644167e1400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x5644167f1e60 tx=0x564416826d80).read_frame 2021-01-27T13:35:32.409 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf5524700 1 -- 172.21.15.99:0/2004198298 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5644167f64e0 con 0x564416874c00 2021-01-27T13:35:32.409 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf6526700 20 -- 172.21.15.99:0/2004198298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564416874c00 msgr2=0x5644167e1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T13:35:32.410 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf5524700 10 -- 172.21.15.99:0/2004198298 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T13:35:32.410 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:31 smithi099 bash[20224]: debug 2021-01-27T13:35:31.986+0000 7f1cf5524700 20 -- 172.21.15.99:0/2004198298 done calling dispatch on 0x5644167f64e0 2021-01-27T13:35:32.804 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:32 smithi099 bash[20224]: debug 2021-01-27T13:35:32.538+0000 7f1cfcfaf200 -1 Falling back to public interface 2021-01-27T13:35:34.054 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:33 smithi099 bash[9889]: cluster 2021-01-27T13:35:32.123396+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:34.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:33 smithi037 bash[9724]: cluster 2021-01-27T13:35:32.123396+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:34.069 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:33 smithi037 bash[13442]: cluster 2021-01-27T13:35:32.123396+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:35.185 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-01-27T13:35:35.185 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "c6ede83c-d95f-4a7e-bedf-0bdeb96d7baf", 2021-01-27T13:35:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "realm", 2021-01-27T13:35:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "current_period": "e86a3364-7bf0-465f-b617-5012f7d4b285", 2021-01-27T13:35:35.186 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 1 2021-01-27T13:35:35.186 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-01-27T13:35:35.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:35 smithi099 bash[9889]: cluster 2021-01-27T13:35:34.122986+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T13:35:35.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:35 smithi099 bash[9889]: cluster 2021-01-27T13:35:34.124694+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:35.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:35 smithi099 bash[9889]: audit 2021-01-27T13:35:34.124914+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:35.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:35 smithi099 bash[9889]: audit 2021-01-27T13:35:34.129051+0000 mon.a (mon.0) 498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T13:35:35.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:35 smithi099 bash[9889]: audit 2021-01-27T13:35:34.129651+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.99:0/3104592496' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T13:35:35.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:35 smithi099 bash[9889]: audit 2021-01-27T13:35:35.012661+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:35.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[9724]: cluster 2021-01-27T13:35:34.122986+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T13:35:35.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[9724]: cluster 2021-01-27T13:35:34.124694+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:35.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[9724]: audit 2021-01-27T13:35:34.124914+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:35.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[9724]: audit 2021-01-27T13:35:34.129051+0000 mon.a (mon.0) 498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T13:35:35.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[9724]: audit 2021-01-27T13:35:34.129651+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.99:0/3104592496' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T13:35:35.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[9724]: audit 2021-01-27T13:35:35.012661+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:35.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[13442]: cluster 2021-01-27T13:35:34.122986+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T13:35:35.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[13442]: cluster 2021-01-27T13:35:34.124694+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:35.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[13442]: audit 2021-01-27T13:35:34.124914+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:35.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[13442]: audit 2021-01-27T13:35:34.129051+0000 mon.a (mon.0) 498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T13:35:35.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[13442]: audit 2021-01-27T13:35:34.129651+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.99:0/3104592496' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T13:35:35.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:35 smithi037 bash[13442]: audit 2021-01-27T13:35:35.012661+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:35.804 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:35 smithi099 bash[20224]: debug 2021-01-27T13:35:35.545+0000 7f1cfcfaf200 -1 osd.7 0 log_to_monitors {default=true} 2021-01-27T13:35:35.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- radosgw-admin zonegroup create --rgw-zonegroup=default --master --default 2021-01-27T13:35:36.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: audit 2021-01-27T13:35:35.127084+0000 mon.a (mon.0) 500 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T13:35:36.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: cluster 2021-01-27T13:35:35.127810+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T13:35:36.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: audit 2021-01-27T13:35:35.129375+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:36.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: audit 2021-01-27T13:35:35.405725+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: audit 2021-01-27T13:35:35.413690+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.307 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: cephadm 2021-01-27T13:35:35.415128+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:36.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: audit 2021-01-27T13:35:35.421776+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: cephadm 2021-01-27T13:35:35.422932+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:36.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: audit 2021-01-27T13:35:35.552105+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T13:35:36.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:36 smithi099 bash[9889]: audit 2021-01-27T13:35:35.554133+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T13:35:36.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: audit 2021-01-27T13:35:35.127084+0000 mon.a (mon.0) 500 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T13:35:36.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: cluster 2021-01-27T13:35:35.127810+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T13:35:36.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: audit 2021-01-27T13:35:35.129375+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:36.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: audit 2021-01-27T13:35:35.405725+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: audit 2021-01-27T13:35:35.413690+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: cephadm 2021-01-27T13:35:35.415128+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:36.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: audit 2021-01-27T13:35:35.421776+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: cephadm 2021-01-27T13:35:35.422932+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:36.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: audit 2021-01-27T13:35:35.552105+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T13:35:36.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[9724]: audit 2021-01-27T13:35:35.554133+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T13:35:36.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: audit 2021-01-27T13:35:35.127084+0000 mon.a (mon.0) 500 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T13:35:36.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: cluster 2021-01-27T13:35:35.127810+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T13:35:36.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: audit 2021-01-27T13:35:35.129375+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:36.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: audit 2021-01-27T13:35:35.405725+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: audit 2021-01-27T13:35:35.413690+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: cephadm 2021-01-27T13:35:35.415128+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:36.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: audit 2021-01-27T13:35:35.421776+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:36.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: cephadm 2021-01-27T13:35:35.422932+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:36.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: audit 2021-01-27T13:35:35.552105+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T13:35:36.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:36 smithi037 bash[13442]: audit 2021-01-27T13:35:35.554133+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T13:35:37.462 INFO:journalctl@ceph.osd.7.smithi099.stdout:Jan 27 13:35:37 smithi099 bash[20224]: debug 2021-01-27T13:35:37.169+0000 7f1cf4d23700 -1 osd.7 0 waiting for initial osdmap 2021-01-27T13:35:37.463 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:37 smithi099 bash[9889]: cluster 2021-01-27T13:35:36.125376+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 33 pgs: 3 creating+peering, 7 active+clean, 23 unknown; 247 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:37.463 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:37 smithi099 bash[9889]: audit 2021-01-27T13:35:36.150389+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T13:35:37.463 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:37 smithi099 bash[9889]: cluster 2021-01-27T13:35:36.150620+0000 mon.a (mon.0) 508 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T13:35:37.463 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:37 smithi099 bash[9889]: audit 2021-01-27T13:35:36.150797+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:37.464 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:37 smithi099 bash[9889]: audit 2021-01-27T13:35:36.152472+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:37.464 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:37 smithi099 bash[9889]: audit 2021-01-27T13:35:36.154653+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:37.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[9724]: cluster 2021-01-27T13:35:36.125376+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 33 pgs: 3 creating+peering, 7 active+clean, 23 unknown; 247 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:37.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[9724]: audit 2021-01-27T13:35:36.150389+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T13:35:37.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[9724]: cluster 2021-01-27T13:35:36.150620+0000 mon.a (mon.0) 508 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T13:35:37.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[9724]: audit 2021-01-27T13:35:36.150797+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:37.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[9724]: audit 2021-01-27T13:35:36.152472+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:37.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[9724]: audit 2021-01-27T13:35:36.154653+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:37.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[13442]: cluster 2021-01-27T13:35:36.125376+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 33 pgs: 3 creating+peering, 7 active+clean, 23 unknown; 247 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T13:35:37.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[13442]: audit 2021-01-27T13:35:36.150389+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[13442]: cluster 2021-01-27T13:35:36.150620+0000 mon.a (mon.0) 508 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[13442]: audit 2021-01-27T13:35:36.150797+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[13442]: audit 2021-01-27T13:35:36.152472+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:37.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:37 smithi037 bash[13442]: audit 2021-01-27T13:35:36.154653+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2021-01-27T13:35:38.305 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:38 smithi099 bash[9889]: audit 2021-01-27T13:35:37.155282+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:35:38.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:38 smithi099 bash[9889]: cluster 2021-01-27T13:35:37.155467+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T13:35:38.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:38 smithi099 bash[9889]: audit 2021-01-27T13:35:37.156378+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:38.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:38 smithi099 bash[9889]: audit 2021-01-27T13:35:37.170575+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:38.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:38 smithi037 bash[9724]: audit 2021-01-27T13:35:37.155282+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:35:38.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:38 smithi037 bash[9724]: cluster 2021-01-27T13:35:37.155467+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T13:35:38.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:38 smithi037 bash[9724]: audit 2021-01-27T13:35:37.156378+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:38.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:38 smithi037 bash[9724]: audit 2021-01-27T13:35:37.170575+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:38 smithi037 bash[13442]: audit 2021-01-27T13:35:37.155282+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2021-01-27T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:38 smithi037 bash[13442]: cluster 2021-01-27T13:35:37.155467+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:38 smithi037 bash[13442]: audit 2021-01-27T13:35:37.156378+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:38.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:38 smithi037 bash[13442]: audit 2021-01-27T13:35:37.170575+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:39.210 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-01-27T13:35:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "87662d8b-5d07-4046-ba5d-9a1ac7e7430e", 2021-01-27T13:35:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default", 2021-01-27T13:35:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "api_name": "default", 2021-01-27T13:35:39.211 INFO:teuthology.orchestra.run.smithi099.stdout: "is_master": "true", 2021-01-27T13:35:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "endpoints": [], 2021-01-27T13:35:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "hostnames": [], 2021-01-27T13:35:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "hostnames_s3website": [], 2021-01-27T13:35:39.212 INFO:teuthology.orchestra.run.smithi099.stdout: "master_zone": "", 2021-01-27T13:35:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "zones": [], 2021-01-27T13:35:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_targets": [], 2021-01-27T13:35:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2021-01-27T13:35:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "realm_id": "c6ede83c-d95f-4a7e-bedf-0bdeb96d7baf", 2021-01-27T13:35:39.213 INFO:teuthology.orchestra.run.smithi099.stdout: "sync_policy": { 2021-01-27T13:35:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: "groups": [] 2021-01-27T13:35:39.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-01-27T13:35:39.214 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-01-27T13:35:39.246 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:39 smithi099 bash[9889]: cluster 2021-01-27T13:35:36.504665+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:35:39.246 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:39 smithi099 bash[9889]: cluster 2021-01-27T13:35:36.504888+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:35:39.247 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:39 smithi099 bash[9889]: cluster 2021-01-27T13:35:38.125980+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v199: 33 pgs: 3 creating+peering, 19 active+clean, 11 unknown; 373 B data, 36 MiB used, 626 GiB / 626 GiB avail; 2.0 KiB/s wr, 2 op/s 2021-01-27T13:35:39.247 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:39 smithi099 bash[9889]: cluster 2021-01-27T13:35:38.168884+0000 mon.a (mon.0) 515 : cluster [INF] osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185] boot 2021-01-27T13:35:39.247 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:39 smithi099 bash[9889]: cluster 2021-01-27T13:35:38.168969+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T13:35:39.248 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:39 smithi099 bash[9889]: audit 2021-01-27T13:35:38.169933+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:39.248 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:39 smithi099 bash[9889]: cluster 2021-01-27T13:35:39.174630+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T13:35:39.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[9724]: cluster 2021-01-27T13:35:36.504665+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:35:39.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[9724]: cluster 2021-01-27T13:35:36.504888+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:35:39.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[9724]: cluster 2021-01-27T13:35:38.125980+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v199: 33 pgs: 3 creating+peering, 19 active+clean, 11 unknown; 373 B data, 36 MiB used, 626 GiB / 626 GiB avail; 2.0 KiB/s wr, 2 op/s 2021-01-27T13:35:39.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[9724]: cluster 2021-01-27T13:35:38.168884+0000 mon.a (mon.0) 515 : cluster [INF] osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185] boot 2021-01-27T13:35:39.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[9724]: cluster 2021-01-27T13:35:38.168969+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T13:35:39.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[9724]: audit 2021-01-27T13:35:38.169933+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:39.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[9724]: cluster 2021-01-27T13:35:39.174630+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T13:35:39.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[13442]: cluster 2021-01-27T13:35:36.504665+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T13:35:39.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[13442]: cluster 2021-01-27T13:35:36.504888+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T13:35:39.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[13442]: cluster 2021-01-27T13:35:38.125980+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v199: 33 pgs: 3 creating+peering, 19 active+clean, 11 unknown; 373 B data, 36 MiB used, 626 GiB / 626 GiB avail; 2.0 KiB/s wr, 2 op/s 2021-01-27T13:35:39.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[13442]: cluster 2021-01-27T13:35:38.168884+0000 mon.a (mon.0) 515 : cluster [INF] osd.7 [v2:172.21.15.99:6824/888607185,v1:172.21.15.99:6825/888607185] boot 2021-01-27T13:35:39.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[13442]: cluster 2021-01-27T13:35:38.168969+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T13:35:39.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[13442]: audit 2021-01-27T13:35:38.169933+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T13:35:39.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:39 smithi037 bash[13442]: cluster 2021-01-27T13:35:39.174630+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T13:35:39.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- radosgw-admin zone create --rgw-zonegroup=default --rgw-zone zone --master --default 2021-01-27T13:35:40.555 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:40 smithi099 bash[9889]: cluster 2021-01-27T13:35:40.184305+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED) 2021-01-27T13:35:40.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:40 smithi037 bash[9724]: cluster 2021-01-27T13:35:40.184305+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED) 2021-01-27T13:35:40.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:40 smithi037 bash[13442]: cluster 2021-01-27T13:35:40.184305+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED) 2021-01-27T13:35:41.502 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:41 smithi099 bash[9889]: cluster 2021-01-27T13:35:40.126722+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v202: 33 pgs: 1 activating, 1 active+recovering+degraded, 8 peering, 22 active+clean, 1 unknown; 478 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s; 1/18 objects misplaced (5.556%) 2021-01-27T13:35:41.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:41 smithi037 bash[9724]: cluster 2021-01-27T13:35:40.126722+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v202: 33 pgs: 1 activating, 1 active+recovering+degraded, 8 peering, 22 active+clean, 1 unknown; 478 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s; 1/18 objects misplaced (5.556%) 2021-01-27T13:35:41.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:41 smithi037 bash[13442]: cluster 2021-01-27T13:35:40.126722+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v202: 33 pgs: 1 activating, 1 active+recovering+degraded, 8 peering, 22 active+clean, 1 unknown; 478 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s; 1/18 objects misplaced (5.556%) 2021-01-27T13:35:43.059 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2021-01-27T13:35:43.059 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "8d3ddf17-38e7-4ced-a2e7-c25dfcd4a8f4", 2021-01-27T13:35:43.059 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zone", 2021-01-27T13:35:43.059 INFO:teuthology.orchestra.run.smithi099.stdout: "domain_root": "zone.rgw.meta:root", 2021-01-27T13:35:43.060 INFO:teuthology.orchestra.run.smithi099.stdout: "control_pool": "zone.rgw.control", 2021-01-27T13:35:43.060 INFO:teuthology.orchestra.run.smithi099.stdout: "gc_pool": "zone.rgw.log:gc", 2021-01-27T13:35:43.060 INFO:teuthology.orchestra.run.smithi099.stdout: "lc_pool": "zone.rgw.log:lc", 2021-01-27T13:35:43.060 INFO:teuthology.orchestra.run.smithi099.stdout: "log_pool": "zone.rgw.log", 2021-01-27T13:35:43.060 INFO:teuthology.orchestra.run.smithi099.stdout: "intent_log_pool": "zone.rgw.log:intent", 2021-01-27T13:35:43.061 INFO:teuthology.orchestra.run.smithi099.stdout: "usage_log_pool": "zone.rgw.log:usage", 2021-01-27T13:35:43.061 INFO:teuthology.orchestra.run.smithi099.stdout: "roles_pool": "zone.rgw.meta:roles", 2021-01-27T13:35:43.061 INFO:teuthology.orchestra.run.smithi099.stdout: "reshard_pool": "zone.rgw.log:reshard", 2021-01-27T13:35:43.061 INFO:teuthology.orchestra.run.smithi099.stdout: "user_keys_pool": "zone.rgw.meta:users.keys", 2021-01-27T13:35:43.061 INFO:teuthology.orchestra.run.smithi099.stdout: "user_email_pool": "zone.rgw.meta:users.email", 2021-01-27T13:35:43.062 INFO:teuthology.orchestra.run.smithi099.stdout: "user_swift_pool": "zone.rgw.meta:users.swift", 2021-01-27T13:35:43.062 INFO:teuthology.orchestra.run.smithi099.stdout: "user_uid_pool": "zone.rgw.meta:users.uid", 2021-01-27T13:35:43.062 INFO:teuthology.orchestra.run.smithi099.stdout: "otp_pool": "zone.rgw.otp", 2021-01-27T13:35:43.062 INFO:teuthology.orchestra.run.smithi099.stdout: "system_key": { 2021-01-27T13:35:43.063 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "", 2021-01-27T13:35:43.063 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "" 2021-01-27T13:35:43.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-01-27T13:35:43.063 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_pools": [ 2021-01-27T13:35:43.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2021-01-27T13:35:43.064 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "default-placement", 2021-01-27T13:35:43.064 INFO:teuthology.orchestra.run.smithi099.stdout: "val": { 2021-01-27T13:35:43.064 INFO:teuthology.orchestra.run.smithi099.stdout: "index_pool": "zone.rgw.buckets.index", 2021-01-27T13:35:43.064 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_classes": { 2021-01-27T13:35:43.064 INFO:teuthology.orchestra.run.smithi099.stdout: "STANDARD": { 2021-01-27T13:35:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: "data_pool": "zone.rgw.buckets.data" 2021-01-27T13:35:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-01-27T13:35:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2021-01-27T13:35:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: "data_extra_pool": "zone.rgw.buckets.non-ec", 2021-01-27T13:35:43.065 INFO:teuthology.orchestra.run.smithi099.stdout: "index_type": 0 2021-01-27T13:35:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-01-27T13:35:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2021-01-27T13:35:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2021-01-27T13:35:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: "realm_id": "c6ede83c-d95f-4a7e-bedf-0bdeb96d7baf", 2021-01-27T13:35:43.066 INFO:teuthology.orchestra.run.smithi099.stdout: "notif_pool": "zone.rgw.log:notif" 2021-01-27T13:35:43.067 INFO:teuthology.orchestra.run.smithi099.stdout:} 2021-01-27T13:35:43.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:43 smithi099 bash[9889]: cluster 2021-01-27T13:35:42.127530+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v203: 33 pgs: 1 activating, 1 active+recovering+degraded, 8 peering, 23 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 171 B/s rd, 1.7 KiB/s wr, 2 op/s; 1/30 objects misplaced (3.333%); 68 B/s, 0 objects/s recovering 2021-01-27T13:35:43.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:43 smithi037 bash[9724]: cluster 2021-01-27T13:35:42.127530+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v203: 33 pgs: 1 activating, 1 active+recovering+degraded, 8 peering, 23 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 171 B/s rd, 1.7 KiB/s wr, 2 op/s; 1/30 objects misplaced (3.333%); 68 B/s, 0 objects/s recovering 2021-01-27T13:35:43.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:43 smithi037 bash[13442]: cluster 2021-01-27T13:35:42.127530+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v203: 33 pgs: 1 activating, 1 active+recovering+degraded, 8 peering, 23 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 171 B/s rd, 1.7 KiB/s wr, 2 op/s; 1/30 objects misplaced (3.333%); 68 B/s, 0 objects/s recovering 2021-01-27T13:35:43.784 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch apply rgw realm zone --placement '1;smithi037=realm.zone.a' 2021-01-27T13:35:44.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:44 smithi099 bash[9889]: cluster 2021-01-27T13:35:44.250502+0000 mon.a (mon.0) 520 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1 pg degraded) 2021-01-27T13:35:44.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:44 smithi099 bash[9889]: cluster 2021-01-27T13:35:44.250575+0000 mon.a (mon.0) 521 : cluster [INF] Cluster is now healthy 2021-01-27T13:35:44.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:44 smithi037 bash[9724]: cluster 2021-01-27T13:35:44.250502+0000 mon.a (mon.0) 520 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1 pg degraded) 2021-01-27T13:35:44.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:44 smithi037 bash[9724]: cluster 2021-01-27T13:35:44.250575+0000 mon.a (mon.0) 521 : cluster [INF] Cluster is now healthy 2021-01-27T13:35:44.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:44 smithi037 bash[13442]: cluster 2021-01-27T13:35:44.250502+0000 mon.a (mon.0) 520 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1 pg degraded) 2021-01-27T13:35:44.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:44 smithi037 bash[13442]: cluster 2021-01-27T13:35:44.250575+0000 mon.a (mon.0) 521 : cluster [INF] Cluster is now healthy 2021-01-27T13:35:45.556 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:45 smithi099 bash[9889]: cluster 2021-01-27T13:35:44.128314+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v204: 33 pgs: 1 activating, 32 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 293 B/s rd, 880 B/s wr, 1 op/s; 73 B/s, 0 objects/s recovering 2021-01-27T13:35:45.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:45 smithi037 bash[9724]: cluster 2021-01-27T13:35:44.128314+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v204: 33 pgs: 1 activating, 32 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 293 B/s rd, 880 B/s wr, 1 op/s; 73 B/s, 0 objects/s recovering 2021-01-27T13:35:45.570 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:45 smithi037 bash[13442]: cluster 2021-01-27T13:35:44.128314+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v204: 33 pgs: 1 activating, 32 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 293 B/s rd, 880 B/s wr, 1 op/s; 73 B/s, 0 objects/s recovering 2021-01-27T13:35:47.300 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled rgw.realm.zone update... 2021-01-27T13:35:47.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:47 smithi037 bash[9724]: cluster 2021-01-27T13:35:46.129051+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.6 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.1 KiB/s wr, 1 op/s; 64 B/s, 0 objects/s recovering 2021-01-27T13:35:47.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:47 smithi037 bash[9724]: audit 2021-01-27T13:35:47.302007+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:47.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:47 smithi037 bash[13442]: cluster 2021-01-27T13:35:46.129051+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.6 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.1 KiB/s wr, 1 op/s; 64 B/s, 0 objects/s recovering 2021-01-27T13:35:47.571 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:47 smithi037 bash[13442]: audit 2021-01-27T13:35:47.302007+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:47.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:47 smithi099 bash[9889]: cluster 2021-01-27T13:35:46.129051+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.6 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.1 KiB/s wr, 1 op/s; 64 B/s, 0 objects/s recovering 2021-01-27T13:35:47.807 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:47 smithi099 bash[9889]: audit 2021-01-27T13:35:47.302007+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:48.016 DEBUG:teuthology.orchestra.run.smithi037:rgw.realm.zone.a> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@rgw.realm.zone.a.service 2021-01-27T13:35:48.018 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi099 2021-01-27T13:35:48.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd pool create iscsi 3 3 replicated 2021-01-27T13:35:48.029 INFO:journalctl@ceph.rgw.realm.zone.a.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:35:49.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:47.293185+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.34373 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi037=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:35:49.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: cephadm 2021-01-27T13:35:47.295083+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi037=realm.zone.a;count:1 2021-01-27T13:35:49.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: cephadm 2021-01-27T13:35:47.304573+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:35:49.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:47.725639+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: cephadm 2021-01-27T13:35:47.727657+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:49.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: cephadm 2021-01-27T13:35:47.728838+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] 2021-01-27T13:35:49.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:47.730187+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T13:35:49.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:47.731496+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T13:35:49.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:47.737820+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T13:35:49.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:48.009289+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:48.018285+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:48.025861+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: cephadm 2021-01-27T13:35:48.027232+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi037=realm.zone.a;count:1 2021-01-27T13:35:49.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:48.032141+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:48.033674+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T13:35:49.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:48.035061+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:49.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: cephadm 2021-01-27T13:35:48.035967+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi037 2021-01-27T13:35:49.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:48 smithi099 bash[9889]: audit 2021-01-27T13:35:48.036708+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T13:35:49.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:47.293185+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.34373 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi037=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:35:49.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: cephadm 2021-01-27T13:35:47.295083+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi037=realm.zone.a;count:1 2021-01-27T13:35:49.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: cephadm 2021-01-27T13:35:47.304573+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:35:49.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:47.725639+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: cephadm 2021-01-27T13:35:47.727657+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:49.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: cephadm 2021-01-27T13:35:47.728838+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] 2021-01-27T13:35:49.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:47.730187+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T13:35:49.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:47.731496+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T13:35:49.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:47.737820+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T13:35:49.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:48.009289+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:48.018285+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:48.025861+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: cephadm 2021-01-27T13:35:48.027232+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi037=realm.zone.a;count:1 2021-01-27T13:35:49.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:48.032141+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:48.033674+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T13:35:49.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:48.035061+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:49.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: cephadm 2021-01-27T13:35:48.035967+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi037 2021-01-27T13:35:49.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[9724]: audit 2021-01-27T13:35:48.036708+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T13:35:49.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:47.293185+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.34373 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi037=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:35:49.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: cephadm 2021-01-27T13:35:47.295083+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi037=realm.zone.a;count:1 2021-01-27T13:35:49.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: cephadm 2021-01-27T13:35:47.304573+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:35:49.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:47.725639+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: cephadm 2021-01-27T13:35:47.727657+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:49.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: cephadm 2021-01-27T13:35:47.728838+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] 2021-01-27T13:35:49.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:47.730187+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T13:35:49.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:47.731496+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T13:35:49.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:47.737820+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T13:35:49.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:48.009289+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:48.018285+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:48.025861+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: cephadm 2021-01-27T13:35:48.027232+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi037=realm.zone.a;count:1 2021-01-27T13:35:49.078 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:48.032141+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:49.078 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:48.033674+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T13:35:49.078 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:48.035061+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:35:49.078 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: cephadm 2021-01-27T13:35:48.035967+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi037 2021-01-27T13:35:49.078 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:48 smithi037 bash[13442]: audit 2021-01-27T13:35:48.036708+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T13:35:49.976 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:49 smithi099 bash[9889]: cluster 2021-01-27T13:35:48.129959+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 513 B/s rd, 1.1 KiB/s wr, 2 op/s; 51 B/s, 0 objects/s recovering 2021-01-27T13:35:50.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:49 smithi037 bash[9724]: cluster 2021-01-27T13:35:48.129959+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 513 B/s rd, 1.1 KiB/s wr, 2 op/s; 51 B/s, 0 objects/s recovering 2021-01-27T13:35:50.002 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:49 smithi037 bash[13442]: cluster 2021-01-27T13:35:48.129959+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 513 B/s rd, 1.1 KiB/s wr, 2 op/s; 51 B/s, 0 objects/s recovering 2021-01-27T13:35:51.521 INFO:journalctl@ceph.rgw.realm.zone.a.smithi037.stdout:Jan 27 13:35:51 smithi037 systemd[1]: Started Ceph rgw.realm.zone.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:35:51.754 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'iscsi' created 2021-01-27T13:35:51.820 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[13442]: cluster 2021-01-27T13:35:50.130746+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v207: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 840 B/s wr, 1 op/s; 46 B/s, 0 objects/s recovering 2021-01-27T13:35:51.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[13442]: audit 2021-01-27T13:35:51.265929+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T13:35:51.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[13442]: audit 2021-01-27T13:35:51.266970+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.99:0/210536067' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T13:35:51.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[13442]: audit 2021-01-27T13:35:51.724084+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:51.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[13442]: audit 2021-01-27T13:35:51.726918+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:51.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[9724]: cluster 2021-01-27T13:35:50.130746+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v207: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 840 B/s wr, 1 op/s; 46 B/s, 0 objects/s recovering 2021-01-27T13:35:51.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[9724]: audit 2021-01-27T13:35:51.265929+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T13:35:51.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[9724]: audit 2021-01-27T13:35:51.266970+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.99:0/210536067' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T13:35:51.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[9724]: audit 2021-01-27T13:35:51.724084+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:51.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:51 smithi037 bash[9724]: audit 2021-01-27T13:35:51.726918+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:52.057 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:51 smithi099 bash[9889]: cluster 2021-01-27T13:35:50.130746+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v207: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 653 B/s rd, 840 B/s wr, 1 op/s; 46 B/s, 0 objects/s recovering 2021-01-27T13:35:52.057 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:51 smithi099 bash[9889]: audit 2021-01-27T13:35:51.265929+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T13:35:52.057 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:51 smithi099 bash[9889]: audit 2021-01-27T13:35:51.266970+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.99:0/210536067' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T13:35:52.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:51 smithi099 bash[9889]: audit 2021-01-27T13:35:51.724084+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:52.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:51 smithi099 bash[9889]: audit 2021-01-27T13:35:51.726918+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:35:52.412 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd pool application enable iscsi rbd 2021-01-27T13:35:53.057 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:52 smithi099 bash[9889]: audit 2021-01-27T13:35:51.748998+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T13:35:53.057 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:52 smithi099 bash[9889]: cluster 2021-01-27T13:35:51.749138+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T13:35:53.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:52 smithi037 bash[9724]: audit 2021-01-27T13:35:51.748998+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T13:35:53.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:52 smithi037 bash[9724]: cluster 2021-01-27T13:35:51.749138+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T13:35:53.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:52 smithi037 bash[13442]: audit 2021-01-27T13:35:51.748998+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T13:35:53.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:52 smithi037 bash[13442]: cluster 2021-01-27T13:35:51.749138+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T13:35:53.862 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:53 smithi099 bash[9889]: cluster 2021-01-27T13:35:52.131269+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v209: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 511 B/s wr, 1 op/s; 10 B/s, 0 objects/s recovering 2021-01-27T13:35:53.863 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:53 smithi099 bash[9889]: cluster 2021-01-27T13:35:52.751922+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T13:35:53.863 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:53 smithi099 bash[9889]: audit 2021-01-27T13:35:53.348076+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:53.863 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:53 smithi099 bash[9889]: audit 2021-01-27T13:35:53.354108+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:53.863 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:53 smithi099 bash[9889]: audit 2021-01-27T13:35:53.364140+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:54.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[9724]: cluster 2021-01-27T13:35:52.131269+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v209: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 511 B/s wr, 1 op/s; 10 B/s, 0 objects/s recovering 2021-01-27T13:35:54.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[9724]: cluster 2021-01-27T13:35:52.751922+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T13:35:54.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[9724]: audit 2021-01-27T13:35:53.348076+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:54.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[9724]: audit 2021-01-27T13:35:53.354108+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:54.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[9724]: audit 2021-01-27T13:35:53.364140+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:54.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[13442]: cluster 2021-01-27T13:35:52.131269+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v209: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 511 B/s wr, 1 op/s; 10 B/s, 0 objects/s recovering 2021-01-27T13:35:54.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[13442]: cluster 2021-01-27T13:35:52.751922+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T13:35:54.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[13442]: audit 2021-01-27T13:35:53.348076+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:54.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[13442]: audit 2021-01-27T13:35:53.354108+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:54.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:53 smithi037 bash[13442]: audit 2021-01-27T13:35:53.364140+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:54.808 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:54 smithi099 bash[9889]: cephadm 2021-01-27T13:35:53.355596+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:54.808 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:54 smithi099 bash[9889]: cephadm 2021-01-27T13:35:53.356377+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:35:54.808 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:54 smithi099 bash[9889]: cephadm 2021-01-27T13:35:53.365294+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:54.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:54 smithi099 bash[9889]: cephadm 2021-01-27T13:35:53.365942+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:35:54.809 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:54 smithi099 bash[9889]: cluster 2021-01-27T13:35:53.765056+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T13:35:54.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:54 smithi099 bash[9889]: audit 2021-01-27T13:35:53.773434+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.37:0/1308964150' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T13:35:54.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:54 smithi099 bash[9889]: audit 2021-01-27T13:35:53.774364+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T13:35:54.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:54 smithi099 bash[9889]: audit 2021-01-27T13:35:54.272840+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:55.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[9724]: cephadm 2021-01-27T13:35:53.355596+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:55.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[9724]: cephadm 2021-01-27T13:35:53.356377+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:35:55.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[9724]: cephadm 2021-01-27T13:35:53.365294+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:55.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[9724]: cephadm 2021-01-27T13:35:53.365942+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:35:55.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[9724]: cluster 2021-01-27T13:35:53.765056+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T13:35:55.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[9724]: audit 2021-01-27T13:35:53.773434+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.37:0/1308964150' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T13:35:55.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[9724]: audit 2021-01-27T13:35:53.774364+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T13:35:55.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[9724]: audit 2021-01-27T13:35:54.272840+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:55.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[13442]: cephadm 2021-01-27T13:35:53.355596+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:55.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[13442]: cephadm 2021-01-27T13:35:53.356377+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:35:55.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[13442]: cephadm 2021-01-27T13:35:53.365294+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:35:55.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[13442]: cephadm 2021-01-27T13:35:53.365942+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:35:55.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[13442]: cluster 2021-01-27T13:35:53.765056+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T13:35:55.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[13442]: audit 2021-01-27T13:35:53.773434+0000 mon.c (mon.1) 12 : audit [INF] from='client.? 172.21.15.37:0/1308964150' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T13:35:55.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[13442]: audit 2021-01-27T13:35:53.774364+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T13:35:55.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:54 smithi037 bash[13442]: audit 2021-01-27T13:35:54.272840+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:35:56.057 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:55 smithi099 bash[9889]: cluster 2021-01-27T13:35:54.131917+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v212: 68 pgs: 34 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-27T13:35:56.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:55 smithi099 bash[9889]: audit 2021-01-27T13:35:54.783601+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T13:35:56.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:55 smithi099 bash[9889]: cluster 2021-01-27T13:35:54.783949+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T13:35:56.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:55 smithi037 bash[9724]: cluster 2021-01-27T13:35:54.131917+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v212: 68 pgs: 34 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-27T13:35:56.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:55 smithi037 bash[9724]: audit 2021-01-27T13:35:54.783601+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T13:35:56.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:55 smithi037 bash[9724]: cluster 2021-01-27T13:35:54.783949+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T13:35:56.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:55 smithi037 bash[13442]: cluster 2021-01-27T13:35:54.131917+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v212: 68 pgs: 34 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-27T13:35:56.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:55 smithi037 bash[13442]: audit 2021-01-27T13:35:54.783601+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T13:35:56.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:55 smithi037 bash[13442]: cluster 2021-01-27T13:35:54.783949+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T13:35:56.824 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rbd' on pool 'iscsi' 2021-01-27T13:35:57.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:56 smithi099 bash[9889]: cluster 2021-01-27T13:35:55.791479+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T13:35:57.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:56 smithi099 bash[9889]: audit 2021-01-27T13:35:55.799872+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.37:0/1308964150' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T13:35:57.059 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:56 smithi099 bash[9889]: audit 2021-01-27T13:35:55.803873+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T13:35:57.059 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:56 smithi099 bash[9889]: audit 2021-01-27T13:35:55.910538+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T13:35:57.059 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:56 smithi099 bash[9889]: audit 2021-01-27T13:35:55.911067+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.99:0/4115598471' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T13:35:57.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[13442]: cluster 2021-01-27T13:35:55.791479+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T13:35:57.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[13442]: audit 2021-01-27T13:35:55.799872+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.37:0/1308964150' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T13:35:57.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[13442]: audit 2021-01-27T13:35:55.803873+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T13:35:57.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[13442]: audit 2021-01-27T13:35:55.910538+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T13:35:57.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[13442]: audit 2021-01-27T13:35:55.911067+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.99:0/4115598471' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T13:35:57.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[9724]: cluster 2021-01-27T13:35:55.791479+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T13:35:57.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[9724]: audit 2021-01-27T13:35:55.799872+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.15.37:0/1308964150' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T13:35:57.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[9724]: audit 2021-01-27T13:35:55.803873+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T13:35:57.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[9724]: audit 2021-01-27T13:35:55.910538+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T13:35:57.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:56 smithi037 bash[9724]: audit 2021-01-27T13:35:55.911067+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.99:0/4115598471' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T13:35:57.654 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch apply iscsi iscsi user password --placement '1;smithi099=iscsi.a' 2021-01-27T13:35:58.057 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:57 smithi099 bash[9889]: cluster 2021-01-27T13:35:56.132654+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v215: 100 pgs: 5 creating+peering, 43 unknown, 52 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T13:35:58.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:57 smithi099 bash[9889]: audit 2021-01-27T13:35:56.803277+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T13:35:58.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:57 smithi099 bash[9889]: audit 2021-01-27T13:35:56.803619+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T13:35:58.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:57 smithi099 bash[9889]: cluster 2021-01-27T13:35:56.803737+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T13:35:58.070 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:57 smithi037 bash[13442]: cluster 2021-01-27T13:35:56.132654+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v215: 100 pgs: 5 creating+peering, 43 unknown, 52 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T13:35:58.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:57 smithi037 bash[13442]: audit 2021-01-27T13:35:56.803277+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T13:35:58.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:57 smithi037 bash[13442]: audit 2021-01-27T13:35:56.803619+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T13:35:58.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:57 smithi037 bash[13442]: cluster 2021-01-27T13:35:56.803737+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T13:35:58.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:57 smithi037 bash[9724]: cluster 2021-01-27T13:35:56.132654+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v215: 100 pgs: 5 creating+peering, 43 unknown, 52 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T13:35:58.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:57 smithi037 bash[9724]: audit 2021-01-27T13:35:56.803277+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T13:35:58.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:57 smithi037 bash[9724]: audit 2021-01-27T13:35:56.803619+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T13:35:58.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:57 smithi037 bash[9724]: cluster 2021-01-27T13:35:56.803737+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T13:35:59.071 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:58 smithi037 bash[9724]: cluster 2021-01-27T13:35:57.814556+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T13:35:59.071 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:58 smithi037 bash[13442]: cluster 2021-01-27T13:35:57.814556+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T13:35:59.181 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:58 smithi099 bash[9889]: cluster 2021-01-27T13:35:57.814556+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T13:36:00.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:59 smithi099 bash[9889]: cluster 2021-01-27T13:35:58.133314+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v218: 100 pgs: 13 creating+peering, 30 unknown, 57 active+clean; 1.9 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-01-27T13:36:00.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:59 smithi099 bash[9889]: cluster 2021-01-27T13:35:58.830693+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T13:36:00.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:59 smithi099 bash[9889]: audit 2021-01-27T13:35:58.833791+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T13:36:00.059 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:35:59 smithi099 bash[9889]: audit 2021-01-27T13:35:58.834701+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T13:36:00.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:59 smithi037 bash[9724]: cluster 2021-01-27T13:35:58.133314+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v218: 100 pgs: 13 creating+peering, 30 unknown, 57 active+clean; 1.9 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-01-27T13:36:00.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:59 smithi037 bash[9724]: cluster 2021-01-27T13:35:58.830693+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T13:36:00.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:59 smithi037 bash[9724]: audit 2021-01-27T13:35:58.833791+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T13:36:00.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:35:59 smithi037 bash[9724]: audit 2021-01-27T13:35:58.834701+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T13:36:00.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:59 smithi037 bash[13442]: cluster 2021-01-27T13:35:58.133314+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v218: 100 pgs: 13 creating+peering, 30 unknown, 57 active+clean; 1.9 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-01-27T13:36:00.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:59 smithi037 bash[13442]: cluster 2021-01-27T13:35:58.830693+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T13:36:00.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:59 smithi037 bash[13442]: audit 2021-01-27T13:35:58.833791+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T13:36:00.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:35:59 smithi037 bash[13442]: audit 2021-01-27T13:35:58.834701+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T13:36:01.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:00 smithi099 bash[9889]: audit 2021-01-27T13:35:59.836622+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T13:36:01.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:00 smithi099 bash[9889]: cluster 2021-01-27T13:35:59.838508+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T13:36:01.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:00 smithi099 bash[9889]: audit 2021-01-27T13:35:59.851223+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T13:36:01.058 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:00 smithi099 bash[9889]: audit 2021-01-27T13:35:59.851990+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T13:36:01.177 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled iscsi.iscsi update... 2021-01-27T13:36:01.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:00 smithi037 bash[9724]: audit 2021-01-27T13:35:59.836622+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T13:36:01.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:00 smithi037 bash[9724]: cluster 2021-01-27T13:35:59.838508+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T13:36:01.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:00 smithi037 bash[9724]: audit 2021-01-27T13:35:59.851223+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T13:36:01.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:00 smithi037 bash[9724]: audit 2021-01-27T13:35:59.851990+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T13:36:01.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:00 smithi037 bash[13442]: audit 2021-01-27T13:35:59.836622+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T13:36:01.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:00 smithi037 bash[13442]: cluster 2021-01-27T13:35:59.838508+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T13:36:01.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:00 smithi037 bash[13442]: audit 2021-01-27T13:35:59.851223+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T13:36:01.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:00 smithi037 bash[13442]: audit 2021-01-27T13:35:59.851990+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T13:36:02.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: cluster 2021-01-27T13:36:00.134176+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v221: 132 pgs: 13 creating+peering, 35 unknown, 84 active+clean; 8.6 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 11 KiB/s wr, 45 op/s 2021-01-27T13:36:02.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:00.863122+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T13:36:02.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: cluster 2021-01-27T13:36:00.863307+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T13:36:02.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:00.865540+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T13:36:02.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:00.866475+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T13:36:02.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:01.178325+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:01.189956+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:01.211726+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:01.213115+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T13:36:02.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:01.221114+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T13:36:02.066 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:01.238708+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:36:02.067 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:01 smithi099 bash[9889]: audit 2021-01-27T13:36:01.240825+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T13:36:02.309 DEBUG:teuthology.orchestra.run.smithi099:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@iscsi.iscsi.a.service 2021-01-27T13:36:02.312 INFO:tasks.cephadm:Adding prometheus.a on smithi099 2021-01-27T13:36:02.312 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch apply prometheus '1;smithi099=a' 2021-01-27T13:36:02.320 INFO:journalctl@ceph.rgw.realm.zone.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[24964]: debug 2021-01-27T13:36:02.034+0000 7ff7b2d8e2c0 -1 rgw period pusher: The new period does not contain my zonegroup! 2021-01-27T13:36:02.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: cluster 2021-01-27T13:36:00.134176+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v221: 132 pgs: 13 creating+peering, 35 unknown, 84 active+clean; 8.6 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 11 KiB/s wr, 45 op/s 2021-01-27T13:36:02.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:00.863122+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T13:36:02.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: cluster 2021-01-27T13:36:00.863307+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T13:36:02.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:00.865540+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T13:36:02.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:00.866475+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T13:36:02.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:01.178325+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:01.189956+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:01.211726+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:01.213115+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T13:36:02.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:01.221114+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T13:36:02.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:01.238708+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:36:02.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[13442]: audit 2021-01-27T13:36:01.240825+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T13:36:02.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: cluster 2021-01-27T13:36:00.134176+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v221: 132 pgs: 13 creating+peering, 35 unknown, 84 active+clean; 8.6 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 11 KiB/s wr, 45 op/s 2021-01-27T13:36:02.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:00.863122+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T13:36:02.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: cluster 2021-01-27T13:36:00.863307+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T13:36:02.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:00.865540+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.37:0/626813133' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T13:36:02.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:00.866475+0000 mon.a (mon.0) 562 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T13:36:02.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:01.178325+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:01.189956+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:01.211726+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:02.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:01.213115+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T13:36:02.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:01.221114+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T13:36:02.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:01.238708+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T13:36:02.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:01 smithi037 bash[9724]: audit 2021-01-27T13:36:01.240825+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T13:36:02.484 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:36:03.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: audit 2021-01-27T13:36:01.168942+0000 mgr.y (mgr.14138) 256 : audit [DBG] from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi099=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:03.595 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cephadm 2021-01-27T13:36:01.171501+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi099=iscsi.a;count:1 2021-01-27T13:36:03.595 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cephadm 2021-01-27T13:36:01.191327+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:03.595 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cephadm 2021-01-27T13:36:01.192054+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:03.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cephadm 2021-01-27T13:36:01.192890+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] 2021-01-27T13:36:03.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cephadm 2021-01-27T13:36:01.193235+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T13:36:03.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cephadm 2021-01-27T13:36:01.204556+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi099=iscsi.a;count:1 2021-01-27T13:36:03.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cephadm 2021-01-27T13:36:01.239732+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi099 2021-01-27T13:36:03.596 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: audit 2021-01-27T13:36:01.865719+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T13:36:03.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cluster 2021-01-27T13:36:01.865861+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T13:36:03.597 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:02 smithi099 bash[9889]: cluster 2021-01-27T13:36:02.228840+0000 mon.a (mon.0) 572 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-27T13:36:03.598 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: audit 2021-01-27T13:36:01.168942+0000 mgr.y (mgr.14138) 256 : audit [DBG] from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi099=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:03.598 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cephadm 2021-01-27T13:36:01.171501+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi099=iscsi.a;count:1 2021-01-27T13:36:03.598 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cephadm 2021-01-27T13:36:01.191327+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:03.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cephadm 2021-01-27T13:36:01.192054+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:03.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cephadm 2021-01-27T13:36:01.192890+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] 2021-01-27T13:36:03.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cephadm 2021-01-27T13:36:01.193235+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T13:36:03.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cephadm 2021-01-27T13:36:01.204556+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi099=iscsi.a;count:1 2021-01-27T13:36:03.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cephadm 2021-01-27T13:36:01.239732+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi099 2021-01-27T13:36:03.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: audit 2021-01-27T13:36:01.865719+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T13:36:03.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cluster 2021-01-27T13:36:01.865861+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T13:36:03.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[9724]: cluster 2021-01-27T13:36:02.228840+0000 mon.a (mon.0) 572 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-27T13:36:03.600 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: audit 2021-01-27T13:36:01.168942+0000 mgr.y (mgr.14138) 256 : audit [DBG] from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi099=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:03.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cephadm 2021-01-27T13:36:01.171501+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi099=iscsi.a;count:1 2021-01-27T13:36:03.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cephadm 2021-01-27T13:36:01.191327+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:03.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cephadm 2021-01-27T13:36:01.192054+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:03.601 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cephadm 2021-01-27T13:36:01.192890+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] 2021-01-27T13:36:03.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cephadm 2021-01-27T13:36:01.193235+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T13:36:03.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cephadm 2021-01-27T13:36:01.204556+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi099=iscsi.a;count:1 2021-01-27T13:36:03.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cephadm 2021-01-27T13:36:01.239732+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi099 2021-01-27T13:36:03.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: audit 2021-01-27T13:36:01.865719+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T13:36:03.602 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cluster 2021-01-27T13:36:01.865861+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T13:36:03.603 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:02 smithi037 bash[13442]: cluster 2021-01-27T13:36:02.228840+0000 mon.a (mon.0) 572 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-27T13:36:04.030 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:03 smithi099 bash[9889]: cluster 2021-01-27T13:36:02.134909+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v224: 132 pgs: 5 creating+peering, 11 unknown, 116 active+clean; 21 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 32 KiB/s wr, 127 op/s 2021-01-27T13:36:04.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:03 smithi037 bash[9724]: cluster 2021-01-27T13:36:02.134909+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v224: 132 pgs: 5 creating+peering, 11 unknown, 116 active+clean; 21 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 32 KiB/s wr, 127 op/s 2021-01-27T13:36:04.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:03 smithi037 bash[13442]: cluster 2021-01-27T13:36:02.134909+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v224: 132 pgs: 5 creating+peering, 11 unknown, 116 active+clean; 21 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 32 KiB/s rd, 32 KiB/s wr, 127 op/s 2021-01-27T13:36:05.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:05 smithi099 systemd[1]: Started Ceph iscsi.iscsi.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:36:06.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:05 smithi099 bash[9889]: cluster 2021-01-27T13:36:04.135977+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v225: 132 pgs: 5 creating+peering, 127 active+clean; 22 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 22 KiB/s wr, 128 op/s 2021-01-27T13:36:06.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:05 smithi099 bash[9889]: audit 2021-01-27T13:36:05.306132+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:06.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:05 smithi099 bash[9889]: audit 2021-01-27T13:36:05.309288+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:06.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:05 smithi037 bash[9724]: cluster 2021-01-27T13:36:04.135977+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v225: 132 pgs: 5 creating+peering, 127 active+clean; 22 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 22 KiB/s wr, 128 op/s 2021-01-27T13:36:06.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:05 smithi037 bash[9724]: audit 2021-01-27T13:36:05.306132+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:06.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:05 smithi037 bash[9724]: audit 2021-01-27T13:36:05.309288+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:06.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:05 smithi037 bash[13442]: cluster 2021-01-27T13:36:04.135977+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v225: 132 pgs: 5 creating+peering, 127 active+clean; 22 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 22 KiB/s wr, 128 op/s 2021-01-27T13:36:06.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:05 smithi037 bash[13442]: audit 2021-01-27T13:36:05.306132+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:06.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:05 smithi037 bash[13442]: audit 2021-01-27T13:36:05.309288+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:07.506 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: cluster 2021-01-27T13:36:06.137164+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 24 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 18 KiB/s wr, 198 op/s 2021-01-27T13:36:07.507 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.437069+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.507 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.445162+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.507 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: cephadm 2021-01-27T13:36:06.446920+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:07.507 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: cephadm 2021-01-27T13:36:06.448119+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:07.507 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: cephadm 2021-01-27T13:36:06.449230+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:07.508 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.457277+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T13:36:07.508 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.458324+0000 mgr.y (mgr.14138) 270 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T13:36:07.508 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: cephadm 2021-01-27T13:36:06.461662+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2021-01-27T13:36:07.508 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.461955+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T13:36:07.508 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.462556+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T13:36:07.509 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.470652+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.509 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.475012+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2021-01-27T13:36:07.509 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.476168+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2021-01-27T13:36:07.509 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.489459+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.509 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: audit 2021-01-27T13:36:06.497527+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: cephadm 2021-01-27T13:36:06.499168+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:07.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: cephadm 2021-01-27T13:36:06.500481+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:07.510 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[9889]: cephadm 2021-01-27T13:36:06.501545+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:07.808 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[22212]: log file path now is '/var/log/tcmu-runner.log' 2021-01-27T13:36:07.809 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[22239]: debug Started the configuration object watcher 2021-01-27T13:36:07.809 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[22239]: debug Checking for config object changes every 1s 2021-01-27T13:36:07.809 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[22239]: debug Processing osd blocklist entries for this node 2021-01-27T13:36:07.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: cluster 2021-01-27T13:36:06.137164+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 24 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 18 KiB/s wr, 198 op/s 2021-01-27T13:36:07.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.437069+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.445162+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: cephadm 2021-01-27T13:36:06.446920+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:07.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: cephadm 2021-01-27T13:36:06.448119+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:07.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: cephadm 2021-01-27T13:36:06.449230+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:07.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.457277+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T13:36:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.458324+0000 mgr.y (mgr.14138) 270 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T13:36:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: cephadm 2021-01-27T13:36:06.461662+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2021-01-27T13:36:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.461955+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T13:36:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.462556+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T13:36:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.470652+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.475012+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2021-01-27T13:36:07.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.476168+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2021-01-27T13:36:07.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.489459+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: audit 2021-01-27T13:36:06.497527+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: cephadm 2021-01-27T13:36:06.499168+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:07.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: cephadm 2021-01-27T13:36:06.500481+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:07.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[9724]: cephadm 2021-01-27T13:36:06.501545+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:07.826 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: cluster 2021-01-27T13:36:06.137164+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 24 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 18 KiB/s wr, 198 op/s 2021-01-27T13:36:07.826 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.437069+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.827 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.445162+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.827 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: cephadm 2021-01-27T13:36:06.446920+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:07.827 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: cephadm 2021-01-27T13:36:06.448119+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:07.827 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: cephadm 2021-01-27T13:36:06.449230+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:07.828 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.457277+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T13:36:07.828 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.458324+0000 mgr.y (mgr.14138) 270 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T13:36:07.828 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: cephadm 2021-01-27T13:36:06.461662+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2021-01-27T13:36:07.828 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.461955+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T13:36:07.828 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.462556+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T13:36:07.829 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.470652+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.829 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.475012+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2021-01-27T13:36:07.829 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.476168+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2021-01-27T13:36:07.829 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.489459+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.829 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: audit 2021-01-27T13:36:06.497527+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:07.830 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: cephadm 2021-01-27T13:36:06.499168+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:07.830 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: cephadm 2021-01-27T13:36:06.500481+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:07.830 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:07 smithi037 bash[13442]: cephadm 2021-01-27T13:36:06.501545+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:07.872 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled prometheus update... 2021-01-27T13:36:08.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[22239]: debug Reading the configuration object to update local LIO configuration 2021-01-27T13:36:08.309 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[22239]: debug Configuration does not have an entry for this host(smithi099.front.sepia.ceph.com) - nothing to define to LIO 2021-01-27T13:36:08.309 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:07 smithi099 bash[22239]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2021-01-27T13:36:08.654 DEBUG:teuthology.orchestra.run.smithi099:prometheus.a> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@prometheus.a.service 2021-01-27T13:36:08.657 INFO:tasks.cephadm:Adding node-exporter.a on smithi037 2021-01-27T13:36:08.657 INFO:tasks.cephadm:Adding node-exporter.b on smithi099 2021-01-27T13:36:08.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch apply node-exporter '2;smithi037=a;smithi099=b' 2021-01-27T13:36:08.682 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:36:08.908 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: audit 2021-01-27T13:36:07.868462+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:08.908 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: cephadm 2021-01-27T13:36:07.870177+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Saving service prometheus spec with placement smithi099=a;count:1 2021-01-27T13:36:08.908 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: audit 2021-01-27T13:36:07.874449+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:08.908 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: audit 2021-01-27T13:36:07.883005+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:08.909 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: cephadm 2021-01-27T13:36:07.884185+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:08.909 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: cephadm 2021-01-27T13:36:07.885135+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:08.909 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: cephadm 2021-01-27T13:36:07.885912+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:08.909 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: cephadm 2021-01-27T13:36:07.886693+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='a')] 2021-01-27T13:36:08.910 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: cephadm 2021-01-27T13:36:07.896701+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Deploying daemon prometheus.a on smithi099 2021-01-27T13:36:08.910 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:08 smithi099 bash[9889]: audit 2021-01-27T13:36:07.950179+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.15.99:0/1952026825' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T13:36:09.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: audit 2021-01-27T13:36:07.868462+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:09.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: cephadm 2021-01-27T13:36:07.870177+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Saving service prometheus spec with placement smithi099=a;count:1 2021-01-27T13:36:09.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: audit 2021-01-27T13:36:07.874449+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:09.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: audit 2021-01-27T13:36:07.883005+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:09.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: cephadm 2021-01-27T13:36:07.884185+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:09.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: cephadm 2021-01-27T13:36:07.885135+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:09.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: cephadm 2021-01-27T13:36:07.885912+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:09.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: cephadm 2021-01-27T13:36:07.886693+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='a')] 2021-01-27T13:36:09.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: cephadm 2021-01-27T13:36:07.896701+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Deploying daemon prometheus.a on smithi099 2021-01-27T13:36:09.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[9724]: audit 2021-01-27T13:36:07.950179+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.15.99:0/1952026825' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T13:36:09.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: audit 2021-01-27T13:36:07.868462+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:09.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: cephadm 2021-01-27T13:36:07.870177+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Saving service prometheus spec with placement smithi099=a;count:1 2021-01-27T13:36:09.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: audit 2021-01-27T13:36:07.874449+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:09.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: audit 2021-01-27T13:36:07.883005+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:09.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: cephadm 2021-01-27T13:36:07.884185+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:09.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: cephadm 2021-01-27T13:36:07.885135+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:09.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: cephadm 2021-01-27T13:36:07.885912+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:09.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: cephadm 2021-01-27T13:36:07.886693+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='a')] 2021-01-27T13:36:09.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: cephadm 2021-01-27T13:36:07.896701+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Deploying daemon prometheus.a on smithi099 2021-01-27T13:36:09.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:08 smithi037 bash[13442]: audit 2021-01-27T13:36:07.950179+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.15.99:0/1952026825' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T13:36:10.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:09 smithi099 bash[9889]: cluster 2021-01-27T13:36:08.138153+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 14 KiB/s wr, 179 op/s 2021-01-27T13:36:10.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:09 smithi037 bash[13442]: cluster 2021-01-27T13:36:08.138153+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 14 KiB/s wr, 179 op/s 2021-01-27T13:36:10.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:09 smithi037 bash[9724]: cluster 2021-01-27T13:36:08.138153+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 14 KiB/s wr, 179 op/s 2021-01-27T13:36:12.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:11 smithi099 bash[9889]: cluster 2021-01-27T13:36:10.139333+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v228: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 5.7 KiB/s wr, 128 op/s 2021-01-27T13:36:12.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:11 smithi037 bash[13442]: cluster 2021-01-27T13:36:10.139333+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v228: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 5.7 KiB/s wr, 128 op/s 2021-01-27T13:36:12.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:11 smithi037 bash[9724]: cluster 2021-01-27T13:36:10.139333+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v228: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 5.7 KiB/s wr, 128 op/s 2021-01-27T13:36:14.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:13 smithi099 bash[9889]: cluster 2021-01-27T13:36:12.140562+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v229: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 3.2 KiB/s wr, 108 op/s 2021-01-27T13:36:14.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:13 smithi037 bash[13442]: cluster 2021-01-27T13:36:12.140562+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v229: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 3.2 KiB/s wr, 108 op/s 2021-01-27T13:36:14.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:13 smithi037 bash[9724]: cluster 2021-01-27T13:36:12.140562+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v229: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 3.2 KiB/s wr, 108 op/s 2021-01-27T13:36:14.876 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled node-exporter update... 2021-01-27T13:36:15.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[13442]: audit 2021-01-27T13:36:14.073957+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-01-27T13:36:15.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[13442]: audit 2021-01-27T13:36:14.074595+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-01-27T13:36:15.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[13442]: audit 2021-01-27T13:36:14.075045+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-01-27T13:36:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[13442]: audit 2021-01-27T13:36:14.075492+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-01-27T13:36:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[13442]: audit 2021-01-27T13:36:14.265522+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:36:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[13442]: audit 2021-01-27T13:36:14.269043+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:36:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[13442]: audit 2021-01-27T13:36:14.281753+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[13442]: audit 2021-01-27T13:36:14.876720+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:15.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[9724]: audit 2021-01-27T13:36:14.073957+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-01-27T13:36:15.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[9724]: audit 2021-01-27T13:36:14.074595+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-01-27T13:36:15.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[9724]: audit 2021-01-27T13:36:14.075045+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-01-27T13:36:15.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[9724]: audit 2021-01-27T13:36:14.075492+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-01-27T13:36:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[9724]: audit 2021-01-27T13:36:14.265522+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:36:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[9724]: audit 2021-01-27T13:36:14.269043+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:36:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[9724]: audit 2021-01-27T13:36:14.281753+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:15.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:14 smithi037 bash[9724]: audit 2021-01-27T13:36:14.876720+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:15.358 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:14 smithi099 bash[9889]: audit 2021-01-27T13:36:14.073957+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-01-27T13:36:15.358 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:14 smithi099 bash[9889]: audit 2021-01-27T13:36:14.074595+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-01-27T13:36:15.358 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:14 smithi099 bash[9889]: audit 2021-01-27T13:36:14.075045+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-01-27T13:36:15.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:14 smithi099 bash[9889]: audit 2021-01-27T13:36:14.075492+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-01-27T13:36:15.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:14 smithi099 bash[9889]: audit 2021-01-27T13:36:14.265522+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:36:15.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:14 smithi099 bash[9889]: audit 2021-01-27T13:36:14.269043+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:36:15.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:14 smithi099 bash[9889]: audit 2021-01-27T13:36:14.281753+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:15.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:14 smithi099 bash[9889]: audit 2021-01-27T13:36:14.876720+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:16.042 DEBUG:teuthology.orchestra.run.smithi037:node-exporter.a> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@node-exporter.a.service 2021-01-27T13:36:16.045 DEBUG:teuthology.orchestra.run.smithi099:node-exporter.b> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@node-exporter.b.service 2021-01-27T13:36:16.047 INFO:tasks.cephadm:Adding alertmanager.a on smithi037 2021-01-27T13:36:16.048 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch apply alertmanager '1;smithi037=a' 2021-01-27T13:36:16.071 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:36:16.129 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:36:16.235 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:15 smithi099 bash[9889]: cluster 2021-01-27T13:36:14.141664+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v230: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.7 KiB/s wr, 93 op/s 2021-01-27T13:36:16.235 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:15 smithi099 bash[9889]: audit 2021-01-27T13:36:14.867622+0000 mgr.y (mgr.14138) 288 : audit [DBG] from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi037=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:16.235 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:15 smithi099 bash[9889]: cephadm 2021-01-27T13:36:14.869943+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Saving service node-exporter spec with placement smithi037=a;smithi099=b;count:2 2021-01-27T13:36:16.235 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:15 smithi099 bash[9889]: audit 2021-01-27T13:36:14.915397+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2021-01-27T13:36:16.236 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:15 smithi099 bash[9889]: audit 2021-01-27T13:36:14.915503+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]': finished 2021-01-27T13:36:16.236 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:15 smithi099 bash[9889]: audit 2021-01-27T13:36:14.915887+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2021-01-27T13:36:16.236 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:15 smithi099 bash[9889]: audit 2021-01-27T13:36:14.915994+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]': finished 2021-01-27T13:36:16.236 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:15 smithi099 bash[9889]: cluster 2021-01-27T13:36:14.916079+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T13:36:16.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[9724]: cluster 2021-01-27T13:36:14.141664+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v230: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.7 KiB/s wr, 93 op/s 2021-01-27T13:36:16.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[9724]: audit 2021-01-27T13:36:14.867622+0000 mgr.y (mgr.14138) 288 : audit [DBG] from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi037=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:16.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[9724]: cephadm 2021-01-27T13:36:14.869943+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Saving service node-exporter spec with placement smithi037=a;smithi099=b;count:2 2021-01-27T13:36:16.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[9724]: audit 2021-01-27T13:36:14.915397+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2021-01-27T13:36:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[9724]: audit 2021-01-27T13:36:14.915503+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]': finished 2021-01-27T13:36:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[9724]: audit 2021-01-27T13:36:14.915887+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2021-01-27T13:36:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[9724]: audit 2021-01-27T13:36:14.915994+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]': finished 2021-01-27T13:36:16.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[9724]: cluster 2021-01-27T13:36:14.916079+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T13:36:16.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[13442]: cluster 2021-01-27T13:36:14.141664+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v230: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.7 KiB/s wr, 93 op/s 2021-01-27T13:36:16.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[13442]: audit 2021-01-27T13:36:14.867622+0000 mgr.y (mgr.14138) 288 : audit [DBG] from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi037=a;smithi099=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:16.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[13442]: cephadm 2021-01-27T13:36:14.869943+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Saving service node-exporter spec with placement smithi037=a;smithi099=b;count:2 2021-01-27T13:36:16.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[13442]: audit 2021-01-27T13:36:14.915397+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2021-01-27T13:36:16.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[13442]: audit 2021-01-27T13:36:14.915503+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]': finished 2021-01-27T13:36:16.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[13442]: audit 2021-01-27T13:36:14.915887+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2021-01-27T13:36:16.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[13442]: audit 2021-01-27T13:36:14.915994+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]': finished 2021-01-27T13:36:16.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:15 smithi037 bash[13442]: cluster 2021-01-27T13:36:14.916079+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T13:36:17.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:16 smithi099 bash[9889]: cluster 2021-01-27T13:36:15.918945+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T13:36:17.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:16 smithi037 bash[9724]: cluster 2021-01-27T13:36:15.918945+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T13:36:17.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:16 smithi037 bash[13442]: cluster 2021-01-27T13:36:15.918945+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T13:36:17.809 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:17 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:36:17.936 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:36:17 smithi037 bash[9955]: debug 2021-01-27T13:36:17.641+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:36:18.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:17 smithi099 bash[9889]: cluster 2021-01-27T13:36:16.142335+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v233: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2021-01-27T13:36:18.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:17 smithi037 bash[9724]: cluster 2021-01-27T13:36:16.142335+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v233: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2021-01-27T13:36:18.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:17 smithi037 bash[13442]: cluster 2021-01-27T13:36:16.142335+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v233: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2021-01-27T13:36:19.201 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:18 smithi099 bash[9889]: audit 2021-01-27T13:36:17.643193+0000 mgr.y (mgr.14138) 291 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:19.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:18 smithi037 bash[9724]: audit 2021-01-27T13:36:17.643193+0000 mgr.y (mgr.14138) 291 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:19.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:18 smithi037 bash[13442]: audit 2021-01-27T13:36:17.643193+0000 mgr.y (mgr.14138) 291 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:20.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:19 smithi099 bash[9889]: cluster 2021-01-27T13:36:18.143290+0000 mgr.y (mgr.14138) 292 : cluster [DBG] pgmap v234: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-01-27T13:36:20.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:19 smithi037 bash[9724]: cluster 2021-01-27T13:36:18.143290+0000 mgr.y (mgr.14138) 292 : cluster [DBG] pgmap v234: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-01-27T13:36:20.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:19 smithi037 bash[13442]: cluster 2021-01-27T13:36:18.143290+0000 mgr.y (mgr.14138) 292 : cluster [DBG] pgmap v234: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-01-27T13:36:21.978 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled alertmanager update... 2021-01-27T13:36:22.202 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:21 smithi099 bash[9889]: cluster 2021-01-27T13:36:20.144462+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v235: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 111 B/s, 1 objects/s recovering 2021-01-27T13:36:22.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:21 smithi037 bash[9724]: cluster 2021-01-27T13:36:20.144462+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v235: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 111 B/s, 1 objects/s recovering 2021-01-27T13:36:22.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:21 smithi037 bash[13442]: cluster 2021-01-27T13:36:20.144462+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v235: 132 pgs: 2 peering, 130 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 111 B/s, 1 objects/s recovering 2021-01-27T13:36:23.022 DEBUG:teuthology.orchestra.run.smithi037:alertmanager.a> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@alertmanager.a.service 2021-01-27T13:36:23.025 INFO:tasks.cephadm:Adding grafana.a on smithi099 2021-01-27T13:36:23.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph orch apply grafana '1;smithi099=a' 2021-01-27T13:36:23.043 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:36:23.238 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:22 smithi099 bash[9889]: audit 2021-01-27T13:36:21.968808+0000 mgr.y (mgr.14138) 294 : audit [DBG] from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi037=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:23.239 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:22 smithi099 bash[9889]: cephadm 2021-01-27T13:36:21.971046+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Saving service alertmanager spec with placement smithi037=a;count:1 2021-01-27T13:36:23.239 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:22 smithi099 bash[9889]: audit 2021-01-27T13:36:21.978947+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:23.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:22 smithi037 bash[9724]: audit 2021-01-27T13:36:21.968808+0000 mgr.y (mgr.14138) 294 : audit [DBG] from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi037=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:23.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:22 smithi037 bash[9724]: cephadm 2021-01-27T13:36:21.971046+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Saving service alertmanager spec with placement smithi037=a;count:1 2021-01-27T13:36:23.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:22 smithi037 bash[9724]: audit 2021-01-27T13:36:21.978947+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:23.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:22 smithi037 bash[13442]: audit 2021-01-27T13:36:21.968808+0000 mgr.y (mgr.14138) 294 : audit [DBG] from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi037=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:23.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:22 smithi037 bash[13442]: cephadm 2021-01-27T13:36:21.971046+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Saving service alertmanager spec with placement smithi037=a;count:1 2021-01-27T13:36:23.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:22 smithi037 bash[13442]: audit 2021-01-27T13:36:21.978947+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:23.809 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:23 smithi099 systemd[1]: Started Ceph prometheus.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:36:24.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:23 smithi099 bash[9889]: cluster 2021-01-27T13:36:22.145654+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 327 B/s, 3 objects/s recovering 2021-01-27T13:36:24.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:23 smithi099 bash[9889]: audit 2021-01-27T13:36:23.586452+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:24.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:23 smithi099 bash[9889]: audit 2021-01-27T13:36:23.589296+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:24.321 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:23 smithi037 bash[9724]: cluster 2021-01-27T13:36:22.145654+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 327 B/s, 3 objects/s recovering 2021-01-27T13:36:24.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:23 smithi037 bash[9724]: audit 2021-01-27T13:36:23.586452+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:24.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:23 smithi037 bash[9724]: audit 2021-01-27T13:36:23.589296+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:24.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:23 smithi037 bash[13442]: cluster 2021-01-27T13:36:22.145654+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 327 B/s, 3 objects/s recovering 2021-01-27T13:36:24.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:23 smithi037 bash[13442]: audit 2021-01-27T13:36:23.586452+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:24.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:23 smithi037 bash[13442]: audit 2021-01-27T13:36:23.589296+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:25.021 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:24 smithi099 bash[9889]: cephadm 2021-01-27T13:36:23.588384+0000 mgr.y (mgr.14138) 297 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:36:25.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:24 smithi037 bash[9724]: cephadm 2021-01-27T13:36:23.588384+0000 mgr.y (mgr.14138) 297 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:36:25.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:25 smithi037 bash[13442]: cephadm 2021-01-27T13:36:23.588384+0000 mgr.y (mgr.14138) 297 : cephadm [INF] refreshing smithi037 facts 2021-01-27T13:36:25.560 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.233Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-01-27T13:36:25.560 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.233Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-01-27T13:36:25.560 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.233Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-01-27T13:36:25.560 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.233Z caller=main.go:339 host_details="(Linux 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 smithi099 (none))" 2021-01-27T13:36:25.561 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.233Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-01-27T13:36:25.561 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.233Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-01-27T13:36:25.561 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.238Z caller=main.go:678 msg="Starting TSDB ..." 2021-01-27T13:36:25.561 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.242Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-01-27T13:36:25.561 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.243Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-01-27T13:36:25.562 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.244Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-01-27T13:36:25.562 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.244Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=947.528µs 2021-01-27T13:36:25.562 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.246Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-01-27T13:36:25.562 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.246Z caller=main.go:695 msg="TSDB started" 2021-01-27T13:36:25.562 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.246Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T13:36:25.563 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.247Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T13:36:25.563 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:36:25 smithi099 bash[23354]: level=info ts=2021-01-27T13:36:25.247Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-27T13:36:26.245 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:26 smithi099 bash[9889]: cluster 2021-01-27T13:36:24.146700+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 284 B/s, 2 objects/s recovering 2021-01-27T13:36:26.245 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:26 smithi099 bash[9889]: audit 2021-01-27T13:36:25.793843+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:26.246 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:26 smithi099 bash[9889]: audit 2021-01-27T13:36:25.802551+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:26.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:26 smithi037 bash[9724]: cluster 2021-01-27T13:36:24.146700+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 284 B/s, 2 objects/s recovering 2021-01-27T13:36:26.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:26 smithi037 bash[9724]: audit 2021-01-27T13:36:25.793843+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:26.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:26 smithi037 bash[9724]: audit 2021-01-27T13:36:25.802551+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:26.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:26 smithi037 bash[13442]: cluster 2021-01-27T13:36:24.146700+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 284 B/s, 2 objects/s recovering 2021-01-27T13:36:26.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:26 smithi037 bash[13442]: audit 2021-01-27T13:36:25.793843+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:26.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:26 smithi037 bash[13442]: audit 2021-01-27T13:36:25.802551+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:26.809 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:26 smithi099 systemd[1]: Started Ceph node-exporter.b for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:36:26.810 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:26 smithi099 bash[23816]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-27T13:36:27.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[9724]: cephadm 2021-01-27T13:36:25.804070+0000 mgr.y (mgr.14138) 299 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:27.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[9724]: cephadm 2021-01-27T13:36:25.804834+0000 mgr.y (mgr.14138) 300 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:27.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[9724]: cephadm 2021-01-27T13:36:25.805708+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:27.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[9724]: cephadm 2021-01-27T13:36:25.806585+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:36:27.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[9724]: cephadm 2021-01-27T13:36:25.807509+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] 2021-01-27T13:36:27.309 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[9724]: cephadm 2021-01-27T13:36:25.808065+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Deploying daemon node-exporter.b on smithi099 2021-01-27T13:36:27.309 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[9724]: audit 2021-01-27T13:36:26.666252+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:27.309 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[13442]: cephadm 2021-01-27T13:36:25.804070+0000 mgr.y (mgr.14138) 299 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:27.309 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[13442]: cephadm 2021-01-27T13:36:25.804834+0000 mgr.y (mgr.14138) 300 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:27.310 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[13442]: cephadm 2021-01-27T13:36:25.805708+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:27.310 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[13442]: cephadm 2021-01-27T13:36:25.806585+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:36:27.310 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[13442]: cephadm 2021-01-27T13:36:25.807509+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] 2021-01-27T13:36:27.310 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[13442]: cephadm 2021-01-27T13:36:25.808065+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Deploying daemon node-exporter.b on smithi099 2021-01-27T13:36:27.310 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[13442]: audit 2021-01-27T13:36:26.666252+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:27.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[9889]: cephadm 2021-01-27T13:36:25.804070+0000 mgr.y (mgr.14138) 299 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:27.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[9889]: cephadm 2021-01-27T13:36:25.804834+0000 mgr.y (mgr.14138) 300 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:27.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[9889]: cephadm 2021-01-27T13:36:25.805708+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:27.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[9889]: cephadm 2021-01-27T13:36:25.806585+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:36:27.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[9889]: cephadm 2021-01-27T13:36:25.807509+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] 2021-01-27T13:36:27.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[9889]: cephadm 2021-01-27T13:36:25.808065+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Deploying daemon node-exporter.b on smithi099 2021-01-27T13:36:27.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[9889]: audit 2021-01-27T13:36:26.666252+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:27.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: v0.18.1: Pulling from prom/node-exporter 2021-01-27T13:36:27.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: 49a2d53aa1af: Pulling fs layer 2021-01-27T13:36:27.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: 3589a6efd9ce: Pulling fs layer 2021-01-27T13:36:27.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: 190160031744: Pulling fs layer 2021-01-27T13:36:27.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: 3589a6efd9ce: Download complete 2021-01-27T13:36:27.314 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: 49a2d53aa1af: Download complete 2021-01-27T13:36:27.314 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: 190160031744: Verifying Checksum 2021-01-27T13:36:27.314 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: 190160031744: Download complete 2021-01-27T13:36:27.495 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled grafana update... 2021-01-27T13:36:27.571 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 systemd[1]: Started Ceph node-exporter.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:36:27.653 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[23816]: 49a2d53aa1af: Pull complete 2021-01-27T13:36:27.933 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[9955]: debug 2021-01-27T13:36:27.649+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:36:27.933 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[25939]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-27T13:36:27.933 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[25939]: v0.18.1: Pulling from prom/node-exporter 2021-01-27T13:36:27.933 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[25939]: 49a2d53aa1af: Pulling fs layer 2021-01-27T13:36:27.934 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[25939]: 3589a6efd9ce: Pulling fs layer 2021-01-27T13:36:27.934 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[25939]: 190160031744: Pulling fs layer 2021-01-27T13:36:28.010 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:27 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:36:28.310 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:28 smithi099 bash[23816]: 3589a6efd9ce: Pull complete 2021-01-27T13:36:28.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:28 smithi099 bash[9889]: cluster 2021-01-27T13:36:26.147823+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s; 256 B/s, 2 objects/s recovering 2021-01-27T13:36:28.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:28 smithi099 bash[9889]: cephadm 2021-01-27T13:36:26.667974+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Deploying daemon node-exporter.a on smithi037 2021-01-27T13:36:28.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:28 smithi099 bash[9889]: audit 2021-01-27T13:36:27.495494+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:28.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:28 smithi099 bash[9889]: audit 2021-01-27T13:36:27.591681+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:28.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[9724]: cluster 2021-01-27T13:36:26.147823+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s; 256 B/s, 2 objects/s recovering 2021-01-27T13:36:28.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[9724]: cephadm 2021-01-27T13:36:26.667974+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Deploying daemon node-exporter.a on smithi037 2021-01-27T13:36:28.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[9724]: audit 2021-01-27T13:36:27.495494+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:28.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[9724]: audit 2021-01-27T13:36:27.591681+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:28.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[13442]: cluster 2021-01-27T13:36:26.147823+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1000 B/s rd, 0 op/s; 256 B/s, 2 objects/s recovering 2021-01-27T13:36:28.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[13442]: cephadm 2021-01-27T13:36:26.667974+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Deploying daemon node-exporter.a on smithi037 2021-01-27T13:36:28.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[13442]: audit 2021-01-27T13:36:27.495494+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:28.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[13442]: audit 2021-01-27T13:36:27.591681+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:28.324 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[25939]: 3589a6efd9ce: Download complete 2021-01-27T13:36:28.324 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[25939]: 49a2d53aa1af: Verifying Checksum 2021-01-27T13:36:28.324 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:27 smithi037 bash[25939]: 49a2d53aa1af: Download complete 2021-01-27T13:36:28.324 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[25939]: 190160031744: Verifying Checksum 2021-01-27T13:36:28.325 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[25939]: 190160031744: Download complete 2021-01-27T13:36:28.325 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[25939]: 49a2d53aa1af: Pull complete 2021-01-27T13:36:28.821 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:28 smithi037 bash[25939]: 3589a6efd9ce: Pull complete 2021-01-27T13:36:28.850 DEBUG:teuthology.orchestra.run.smithi099:grafana.a> sudo journalctl -f -n 0 -u ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@grafana.a.service 2021-01-27T13:36:28.852 INFO:tasks.cephadm:Setting up client nodes... 2021-01-27T13:36:28.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-27T13:36:28.913 INFO:journalctl@ceph.grafana.a.smithi099.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T13:36:29.309 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:28 smithi099 bash[23816]: 190160031744: Pull complete 2021-01-27T13:36:29.310 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:28 smithi099 bash[23816]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-27T13:36:29.310 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:29 smithi099 bash[23816]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-27T13:36:29.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:29 smithi099 bash[9889]: audit 2021-01-27T13:36:27.487601+0000 mgr.y (mgr.14138) 307 : audit [DBG] from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:29.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:29 smithi099 bash[9889]: cephadm 2021-01-27T13:36:27.489521+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Saving service grafana spec with placement smithi099=a;count:1 2021-01-27T13:36:29.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:29 smithi099 bash[9889]: cephadm 2021-01-27T13:36:27.593182+0000 mgr.y (mgr.14138) 309 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='a')] 2021-01-27T13:36:29.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:29 smithi099 bash[9889]: cephadm 2021-01-27T13:36:27.600591+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Deploying daemon alertmanager.a on smithi037 2021-01-27T13:36:29.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:29 smithi099 bash[9889]: audit 2021-01-27T13:36:27.651288+0000 mgr.y (mgr.14138) 311 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:29.322 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[25939]: 190160031744: Pull complete 2021-01-27T13:36:29.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[9724]: audit 2021-01-27T13:36:27.487601+0000 mgr.y (mgr.14138) 307 : audit [DBG] from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:29.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[9724]: cephadm 2021-01-27T13:36:27.489521+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Saving service grafana spec with placement smithi099=a;count:1 2021-01-27T13:36:29.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[9724]: cephadm 2021-01-27T13:36:27.593182+0000 mgr.y (mgr.14138) 309 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='a')] 2021-01-27T13:36:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[9724]: cephadm 2021-01-27T13:36:27.600591+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Deploying daemon alertmanager.a on smithi037 2021-01-27T13:36:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[9724]: audit 2021-01-27T13:36:27.651288+0000 mgr.y (mgr.14138) 311 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:29.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[13442]: audit 2021-01-27T13:36:27.487601+0000 mgr.y (mgr.14138) 307 : audit [DBG] from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T13:36:29.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[13442]: cephadm 2021-01-27T13:36:27.489521+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Saving service grafana spec with placement smithi099=a;count:1 2021-01-27T13:36:29.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[13442]: cephadm 2021-01-27T13:36:27.593182+0000 mgr.y (mgr.14138) 309 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi037', network='', name='a')] 2021-01-27T13:36:29.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[13442]: cephadm 2021-01-27T13:36:27.600591+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Deploying daemon alertmanager.a on smithi037 2021-01-27T13:36:29.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[13442]: audit 2021-01-27T13:36:27.651288+0000 mgr.y (mgr.14138) 311 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:29.822 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:29 smithi037 bash[25939]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-27T13:36:30.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[9889]: cluster 2021-01-27T13:36:28.148718+0000 mgr.y (mgr.14138) 312 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 218 B/s, 2 objects/s recovering 2021-01-27T13:36:30.310 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-27T13:36:30.310 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-27T13:36:30.310 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-27T13:36:30.311 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-27T13:36:30.311 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-27T13:36:30.311 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-27T13:36:30.311 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-27T13:36:30.312 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-27T13:36:30.312 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-27T13:36:30.312 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-27T13:36:30.312 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-27T13:36:30.312 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-27T13:36:30.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-27T13:36:30.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-27T13:36:30.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-27T13:36:30.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-27T13:36:30.313 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-27T13:36:30.314 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-27T13:36:30.314 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-27T13:36:30.314 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-27T13:36:30.314 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-27T13:36:30.314 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-27T13:36:30.315 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-27T13:36:30.315 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-27T13:36:30.315 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-27T13:36:30.315 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-27T13:36:30.315 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-27T13:36:30.316 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-27T13:36:30.316 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-27T13:36:30.316 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-27T13:36:30.316 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-27T13:36:30.316 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-27T13:36:30.317 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-27T13:36:30.317 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-27T13:36:30.317 INFO:journalctl@ceph.node-exporter.b.smithi099.stdout:Jan 27 13:36:30 smithi099 bash[23816]: time="2021-01-27T13:36:30Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-27T13:36:30.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:30 smithi037 bash[9724]: cluster 2021-01-27T13:36:28.148718+0000 mgr.y (mgr.14138) 312 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 218 B/s, 2 objects/s recovering 2021-01-27T13:36:30.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:30 smithi037 bash[13442]: cluster 2021-01-27T13:36:28.148718+0000 mgr.y (mgr.14138) 312 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 218 B/s, 2 objects/s recovering 2021-01-27T13:36:30.571 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:30 smithi037 bash[25939]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-27T13:36:32.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:32 smithi099 bash[9889]: cluster 2021-01-27T13:36:30.149948+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 218 B/s, 2 objects/s recovering 2021-01-27T13:36:32.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[9724]: cluster 2021-01-27T13:36:30.149948+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 218 B/s, 2 objects/s recovering 2021-01-27T13:36:32.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[13442]: cluster 2021-01-27T13:36:30.149948+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 218 B/s, 2 objects/s recovering 2021-01-27T13:36:33.022 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-27T13:36:33.023 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-27T13:36:33.023 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-27T13:36:33.024 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-27T13:36:33.024 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-27T13:36:33.025 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-27T13:36:33.025 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-27T13:36:33.025 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-27T13:36:33.026 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-27T13:36:33.026 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-27T13:36:33.027 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-27T13:36:33.027 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-27T13:36:33.027 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-27T13:36:33.027 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-27T13:36:33.027 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-27T13:36:33.028 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-27T13:36:33.028 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-27T13:36:33.028 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-27T13:36:33.028 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-27T13:36:33.028 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-27T13:36:33.029 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-27T13:36:33.029 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-27T13:36:33.029 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-27T13:36:33.029 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-27T13:36:33.029 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-27T13:36:33.030 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-27T13:36:33.030 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-27T13:36:33.030 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-27T13:36:33.030 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-27T13:36:33.030 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-27T13:36:33.031 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-27T13:36:33.031 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-27T13:36:33.031 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-27T13:36:33.031 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-27T13:36:33.031 INFO:journalctl@ceph.node-exporter.a.smithi037.stdout:Jan 27 13:36:32 smithi037 bash[25939]: time="2021-01-27T13:36:32Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-27T13:36:34.302 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:34 smithi037 bash[9724]: cluster 2021-01-27T13:36:32.151068+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 144 B/s, 1 objects/s recovering 2021-01-27T13:36:34.303 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:34 smithi037 bash[13442]: cluster 2021-01-27T13:36:32.151068+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 144 B/s, 1 objects/s recovering 2021-01-27T13:36:34.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:34 smithi099 bash[9889]: cluster 2021-01-27T13:36:32.151068+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 144 B/s, 1 objects/s recovering 2021-01-27T13:36:36.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:36 smithi099 bash[9889]: cluster 2021-01-27T13:36:34.152115+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:36.321 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:36 smithi037 bash[13442]: cluster 2021-01-27T13:36:34.152115+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:36.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:36 smithi037 bash[9724]: cluster 2021-01-27T13:36:34.152115+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:36.563 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2021-01-27T13:36:36.564 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBkbBFgPDA7IRAATbx4UQ43OB9HoywqRUTJUg== 2021-01-27T13:36:37.309 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:37 smithi099 bash[9889]: audit 2021-01-27T13:36:36.556525+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.37:0/1513539735' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:37.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:37 smithi099 bash[9889]: audit 2021-01-27T13:36:36.557173+0000 mon.a (mon.0) 607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:37.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:37 smithi099 bash[9889]: audit 2021-01-27T13:36:36.562337+0000 mon.a (mon.0) 608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T13:36:37.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:37 smithi037 bash[9724]: audit 2021-01-27T13:36:36.556525+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.37:0/1513539735' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:37.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:37 smithi037 bash[9724]: audit 2021-01-27T13:36:36.557173+0000 mon.a (mon.0) 607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:37.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:37 smithi037 bash[9724]: audit 2021-01-27T13:36:36.562337+0000 mon.a (mon.0) 608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T13:36:37.335 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:37 smithi037 bash[13442]: audit 2021-01-27T13:36:36.556525+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.37:0/1513539735' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:37.335 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:37 smithi037 bash[13442]: audit 2021-01-27T13:36:36.557173+0000 mon.a (mon.0) 607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:37.335 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:37 smithi037 bash[13442]: audit 2021-01-27T13:36:36.562337+0000 mon.a (mon.0) 608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T13:36:38.059 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:36:37 smithi037 bash[9955]: debug 2021-01-27T13:36:37.660+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:36:38.059 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:37 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:36:38.097 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:36:38.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-01-27T13:36:38.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-01-27T13:36:38.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-27T13:36:38.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:38 smithi037 bash[9724]: cluster 2021-01-27T13:36:36.153102+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:38.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:38 smithi037 bash[13442]: cluster 2021-01-27T13:36:36.153102+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:38.324 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:38 smithi099 bash[9889]: cluster 2021-01-27T13:36:36.153102+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:39.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:39 smithi037 bash[9724]: audit 2021-01-27T13:36:37.661984+0000 mgr.y (mgr.14138) 317 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:39.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:39 smithi037 bash[13442]: audit 2021-01-27T13:36:37.661984+0000 mgr.y (mgr.14138) 317 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:39.382 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:39 smithi099 bash[9889]: audit 2021-01-27T13:36:37.661984+0000 mgr.y (mgr.14138) 317 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:40.159 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:40 smithi037 bash[9724]: cluster 2021-01-27T13:36:38.154089+0000 mgr.y (mgr.14138) 318 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:40.160 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:40 smithi037 bash[13442]: cluster 2021-01-27T13:36:38.154089+0000 mgr.y (mgr.14138) 318 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:40.478 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:40 smithi037 systemd[1]: Started Ceph alertmanager.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:36:40.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:40 smithi099 bash[9889]: cluster 2021-01-27T13:36:38.154089+0000 mgr.y (mgr.14138) 318 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:41.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:41 smithi099 bash[9889]: cluster 2021-01-27T13:36:40.154976+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:41.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:41 smithi099 bash[9889]: audit 2021-01-27T13:36:40.414156+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:41.560 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:41 smithi099 bash[9889]: audit 2021-01-27T13:36:40.415860+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:41.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:41 smithi099 bash[9889]: audit 2021-01-27T13:36:40.416267+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:41.698 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2021-01-27T13:36:41.699 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBpbBFgDxgiKRAAMm8rd8E2hXwRpTtyU+RQLg== 2021-01-27T13:36:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[9724]: cluster 2021-01-27T13:36:40.154976+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[9724]: audit 2021-01-27T13:36:40.414156+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[9724]: audit 2021-01-27T13:36:40.415860+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:41.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[9724]: audit 2021-01-27T13:36:40.416267+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:41.751 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[13442]: cluster 2021-01-27T13:36:40.154976+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:41.751 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[13442]: audit 2021-01-27T13:36:40.414156+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:41.751 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[13442]: audit 2021-01-27T13:36:40.415860+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:41.752 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[13442]: audit 2021-01-27T13:36:40.416267+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:42.072 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:41.885Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-27T13:36:42.072 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:41.885Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-27T13:36:42.072 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:41.887Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.37 port=9094 2021-01-27T13:36:42.073 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:41.888Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-27T13:36:42.073 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:41.926Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T13:36:42.073 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:41.927Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T13:36:42.073 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:41 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:41.931Z caller=main.go:497 msg=Listening address=:9093 2021-01-27T13:36:42.343 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2021-01-27T13:36:42.344 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-01-27T13:36:42.344 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-01-27T13:36:42.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T13:36:42.528 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:36:42.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:42 smithi099 bash[9889]: audit 2021-01-27T13:36:41.689355+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.99:0/1940595475' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:42.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:42 smithi099 bash[9889]: audit 2021-01-27T13:36:41.689712+0000 mon.a (mon.0) 612 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:42.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:42 smithi099 bash[9889]: audit 2021-01-27T13:36:41.699439+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T13:36:42.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:42 smithi099 bash[9889]: audit 2021-01-27T13:36:42.247870+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:42.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:42 smithi099 bash[9889]: audit 2021-01-27T13:36:42.259824+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:42.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:42 smithi099 bash[9889]: audit 2021-01-27T13:36:42.264907+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:42.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[13442]: audit 2021-01-27T13:36:41.689355+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.99:0/1940595475' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:42.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[13442]: audit 2021-01-27T13:36:41.689712+0000 mon.a (mon.0) 612 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:42.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[13442]: audit 2021-01-27T13:36:41.699439+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T13:36:42.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[13442]: audit 2021-01-27T13:36:42.247870+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:42.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[13442]: audit 2021-01-27T13:36:42.259824+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:42.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[13442]: audit 2021-01-27T13:36:42.264907+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[9724]: audit 2021-01-27T13:36:41.689355+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.99:0/1940595475' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[9724]: audit 2021-01-27T13:36:41.689712+0000 mon.a (mon.0) 612 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T13:36:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[9724]: audit 2021-01-27T13:36:41.699439+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T13:36:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[9724]: audit 2021-01-27T13:36:42.247870+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:42.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[9724]: audit 2021-01-27T13:36:42.259824+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:42.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:42 smithi037 bash[9724]: audit 2021-01-27T13:36:42.264907+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.704 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cluster 2021-01-27T13:36:42.156411+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:43.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cephadm 2021-01-27T13:36:42.266719+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:43.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cephadm 2021-01-27T13:36:42.267669+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:43.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cephadm 2021-01-27T13:36:42.268632+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:43.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cephadm 2021-01-27T13:36:42.269531+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:36:43.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cephadm 2021-01-27T13:36:42.270509+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:36:43.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cephadm 2021-01-27T13:36:42.271414+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:36:43.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cephadm 2021-01-27T13:36:42.272376+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='a')] 2021-01-27T13:36:43.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: audit 2021-01-27T13:36:42.439265+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.707 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: audit 2021-01-27T13:36:42.445861+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.707 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: audit 2021-01-27T13:36:42.446856+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T13:36:43.707 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: audit 2021-01-27T13:36:42.447661+0000 mgr.y (mgr.14138) 328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T13:36:43.707 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: audit 2021-01-27T13:36:42.455073+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[9724]: cephadm 2021-01-27T13:36:42.461636+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Deploying daemon grafana.a on smithi099 2021-01-27T13:36:43.708 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cluster 2021-01-27T13:36:42.156411+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:43.708 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cephadm 2021-01-27T13:36:42.266719+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:43.708 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cephadm 2021-01-27T13:36:42.267669+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:43.709 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cephadm 2021-01-27T13:36:42.268632+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:43.709 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cephadm 2021-01-27T13:36:42.269531+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:36:43.709 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cephadm 2021-01-27T13:36:42.270509+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:36:43.709 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cephadm 2021-01-27T13:36:42.271414+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:36:43.710 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cephadm 2021-01-27T13:36:42.272376+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='a')] 2021-01-27T13:36:43.710 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: audit 2021-01-27T13:36:42.439265+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.710 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: audit 2021-01-27T13:36:42.445861+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.710 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: audit 2021-01-27T13:36:42.446856+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T13:36:43.710 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: audit 2021-01-27T13:36:42.447661+0000 mgr.y (mgr.14138) 328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T13:36:43.711 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: audit 2021-01-27T13:36:42.455073+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.711 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[13442]: cephadm 2021-01-27T13:36:42.461636+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Deploying daemon grafana.a on smithi099 2021-01-27T13:36:43.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cluster 2021-01-27T13:36:42.156411+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:43.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cephadm 2021-01-27T13:36:42.266719+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:36:43.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cephadm 2021-01-27T13:36:42.267669+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:36:43.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cephadm 2021-01-27T13:36:42.268632+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:36:43.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cephadm 2021-01-27T13:36:42.269531+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:36:43.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cephadm 2021-01-27T13:36:42.270509+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:36:43.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cephadm 2021-01-27T13:36:42.271414+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:36:43.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cephadm 2021-01-27T13:36:42.272376+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi099', network='', name='a')] 2021-01-27T13:36:43.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: audit 2021-01-27T13:36:42.439265+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: audit 2021-01-27T13:36:42.445861+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: audit 2021-01-27T13:36:42.446856+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T13:36:43.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: audit 2021-01-27T13:36:42.447661+0000 mgr.y (mgr.14138) 328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T13:36:43.813 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: audit 2021-01-27T13:36:42.455073+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:43.813 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:43 smithi099 bash[9889]: cephadm 2021-01-27T13:36:42.461636+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Deploying daemon grafana.a on smithi099 2021-01-27T13:36:44.072 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:43 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:43.888Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000185355s 2021-01-27T13:36:45.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:45 smithi099 bash[9889]: cluster 2021-01-27T13:36:44.157737+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:45.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:45 smithi037 bash[9724]: cluster 2021-01-27T13:36:44.157737+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:45.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:45 smithi037 bash[13442]: cluster 2021-01-27T13:36:44.157737+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:45.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2021-01-27T13:36:45.942 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"fsid":"8e2eaa02-60a3-11eb-8f9a-001a4aab830c","created":"2021-01-27T13:29:19.043116+0000","modified":"2021-01-27T13:36:15.909371+0000","last_up_change":"2021-01-27T13:35:38.158909+0000","last_in_change":"2021-01-27T13:35:38.158909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T13:31:06.746921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T13:35:33.629522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T13:35:51.717224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T13:35:53.332662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T13:35:55.249321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T13:35:58.444028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"93075704-87a9-40ed-b48b-0f0d6d82e21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6803","nonce":3717584473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6805","nonce":3717584473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6809","nonce":3717584473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6807","nonce":3717584473}]},"public_addr":"172.21.15.37:6803/3717584473","cluster_addr":"172.21.15.37:6805/3717584473","heartbeat_back_addr":"172.21.15.37:6809/3717584473","heartbeat_front_addr":"172.21.15.37:6807/3717584473","state":["exists","up"]},{"osd":1,"uuid":"ce5756c1-c1b8-45c7-b29e-290411342ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6811","nonce":2975719624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6813","nonce":2975719624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6817","nonce":2975719624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6815","nonce":2975719624}]},"public_addr":"172.21.15.37:6811/2975719624","cluster_addr":"172.21.15.37:6813/2975719624","heartbeat_back_addr":"172.21.15.37:6817/2975719624","heartbeat_front_addr":"172.21.15.37:6815/2975719624","state":["exists","up"]},{"osd":2,"uuid":"a6eecd04-669c-4e2b-adc6-d13bf2367c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6819","nonce":3212740438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6821","nonce":3212740438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6825","nonce":3212740438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6823","nonce":3212740438}]},"public_addr":"172.21.15.37:6819/3212740438","cluster_addr":"172.21.15.37:6821/3212740438","heartbeat_back_addr":"172.21.15.37:6825/3212740438","heartbeat_front_addr":"172.21.15.37:6823/3212740438","state":["exists","up"]},{"osd":3,"uuid":"3bceaf77-1be5-46e0-8259-91102f1a4992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6827","nonce":4063867695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6829","nonce":4063867695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6833","nonce":4063867695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6831","nonce":4063867695}]},"public_addr":"172.21.15.37:6827/4063867695","cluster_addr":"172.21.15.37:6829/4063867695","heartbeat_back_addr":"172.21.15.37:6833/4063867695","heartbeat_front_addr":"172.21.15.37:6831/4063867695","state":["exists","up"]},{"osd":4,"uuid":"ea105ac4-1f5c-4633-ab72-7f98b4f2b71c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6801","nonce":2470343434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6803","nonce":2470343434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6807","nonce":2470343434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6805","nonce":2470343434}]},"public_addr":"172.21.15.99:6801/2470343434","cluster_addr":"172.21.15.99:6803/2470343434","heartbeat_back_addr":"172.21.15.99:6807/2470343434","heartbeat_front_addr":"172.21.15.99:6805/2470343434","state":["exists","up"]},{"osd":5,"uuid":"1fc3490c-96bc-4df1-90aa-a4752db114f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6809","nonce":1575468921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6811","nonce":1575468921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6815","nonce":1575468921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6813","nonce":1575468921}]},"public_addr":"172.21.15.99:6809/1575468921","cluster_addr":"172.21.15.99:6811/1575468921","heartbeat_back_addr":"172.21.15.99:6815/1575468921","heartbeat_front_addr":"172.21.15.99:6813/1575468921","state":["exists","up"]},{"osd":6,"uuid":"99cbcbe8-43df-4778-ab84-4605193bd31c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6817","nonce":2481050874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6819","nonce":2481050874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6823","nonce":2481050874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6821","nonce":2481050874}]},"public_addr":"172.21.15.99:6817/2481050874","cluster_addr":"172.21.15.99:6819/2481050874","heartbeat_back_addr":"172.21.15.99:6823/2481050874","heartbeat_front_addr":"172.21.15.99:6821/2481050874","state":["exists","up"]},{"osd":7,"uuid":"d497a0c5-50a0-45b0-83e6-1058a44038c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6825","nonce":888607185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6827","nonce":888607185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6831","nonce":888607185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6829","nonce":888607185}]},"public_addr":"172.21.15.99:6825/888607185","cluster_addr":"172.21.15.99:6827/888607185","heartbeat_back_addr":"172.21.15.99:6831/888607185","heartbeat_front_addr":"172.21.15.99:6829/888607185","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:32:26.313554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:32:55.954782+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:33:25.389717+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:33:53.032284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:34:17.196786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:34:43.904841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:35:09.799732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:35:36.504895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":7,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2834625275":"2021-01-28T13:30:13.087341+0000","172.21.15.37:6800/2834625275":"2021-01-28T13:30:13.087341+0000","172.21.15.37:0/4030211386":"2021-01-28T13:30:13.087341+0000","172.21.15.37:0/588400976":"2021-01-28T13:29:50.235508+0000","172.21.15.37:0/3061529231":"2021-01-28T13:29:50.235508+0000","172.21.15.37:6800/2077595097":"2021-01-28T13:29:50.235508+0000","172.21.15.37:0/2633512979":"2021-01-28T13:30:13.087341+0000","172.21.15.37:6801/2077595097":"2021-01-28T13:29:50.235508+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T13:36:46.727 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T13:31:06.746921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-01-27T13:35:33.629522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-01-27T13:35:51.717224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'zone.rgw.log', 'create_time': '2021-01-27T13:35:53.332662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'zone.rgw.control', 'create_time': '2021-01-27T13:35:55.249321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'zone.rgw.meta', 'create_time': '2021-01-27T13:35:58.444028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2021-01-27T13:36:46.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-01-27T13:36:46.736 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:46 smithi037 bash[13442]: audit 2021-01-27T13:36:45.940371+0000 mon.a (mon.0) 621 : audit [DBG] from='client.? 172.21.15.37:0/1058279265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:36:46.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:46 smithi037 bash[9724]: audit 2021-01-27T13:36:45.940371+0000 mon.a (mon.0) 621 : audit [DBG] from='client.? 172.21.15.37:0/1058279265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:36:46.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:46 smithi099 bash[9889]: audit 2021-01-27T13:36:45.940371+0000 mon.a (mon.0) 621 : audit [DBG] from='client.? 172.21.15.37:0/1058279265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:36:46.886 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:36:47.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:47 smithi099 bash[9889]: cluster 2021-01-27T13:36:46.158858+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:47.810 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:47 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:36:47.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:47 smithi037 bash[9724]: cluster 2021-01-27T13:36:46.158858+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:47.823 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:36:47 smithi037 bash[9955]: debug 2021-01-27T13:36:47.668+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:36:47.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:47 smithi037 bash[13442]: cluster 2021-01-27T13:36:46.158858+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:48.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:48 smithi099 bash[9889]: audit 2021-01-27T13:36:47.671151+0000 mgr.y (mgr.14138) 332 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:48.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:48 smithi037 bash[9724]: audit 2021-01-27T13:36:47.671151+0000 mgr.y (mgr.14138) 332 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:48.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:48 smithi037 bash[13442]: audit 2021-01-27T13:36:47.671151+0000 mgr.y (mgr.14138) 332 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:49.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:49 smithi099 bash[9889]: cluster 2021-01-27T13:36:48.159825+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:49.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:49 smithi037 bash[9724]: cluster 2021-01-27T13:36:48.159825+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:49.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:49 smithi037 bash[13442]: cluster 2021-01-27T13:36:48.159825+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:50.239 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2021-01-27T13:36:50.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:50 smithi037 bash[9724]: audit 2021-01-27T13:36:50.239986+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.37:0/3320396378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T13:36:50.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:50 smithi037 bash[13442]: audit 2021-01-27T13:36:50.239986+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.37:0/3320396378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T13:36:50.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:50 smithi099 bash[9889]: audit 2021-01-27T13:36:50.239986+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.37:0/3320396378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T13:36:51.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2021-01-27T13:36:51.245 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:36:51.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:51 smithi037 bash[9724]: cluster 2021-01-27T13:36:50.160961+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:51.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:51 smithi037 bash[13442]: cluster 2021-01-27T13:36:50.160961+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:51.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:51 smithi099 bash[9889]: cluster 2021-01-27T13:36:50.160961+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:52.322 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:36:51 smithi037 bash[26510]: level=info ts=2021-01-27T13:36:51.889Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001335302s 2021-01-27T13:36:53.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:53 smithi099 bash[9889]: cluster 2021-01-27T13:36:52.162168+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:53.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:53 smithi037 bash[9724]: cluster 2021-01-27T13:36:52.162168+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:53.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:53 smithi037 bash[13442]: cluster 2021-01-27T13:36:52.162168+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:54.492 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2021-01-27T13:36:54.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:54 smithi099 bash[9889]: audit 2021-01-27T13:36:54.492727+0000 mon.a (mon.0) 622 : audit [DBG] from='client.? 172.21.15.37:0/2672174773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T13:36:54.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:54 smithi037 bash[9724]: audit 2021-01-27T13:36:54.492727+0000 mon.a (mon.0) 622 : audit [DBG] from='client.? 172.21.15.37:0/2672174773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T13:36:54.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:54 smithi037 bash[13442]: audit 2021-01-27T13:36:54.492727+0000 mon.a (mon.0) 622 : audit [DBG] from='client.? 172.21.15.37:0/2672174773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T13:36:55.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd pool get iscsi pg_num 2021-01-27T13:36:55.454 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:36:55.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:55 smithi037 bash[9724]: cluster 2021-01-27T13:36:54.163553+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:55.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:55 smithi037 bash[13442]: cluster 2021-01-27T13:36:54.163553+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:55.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:55 smithi099 bash[9889]: cluster 2021-01-27T13:36:54.163553+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:36:57.610 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:57 smithi099 bash[9889]: cluster 2021-01-27T13:36:56.164737+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:57.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:57 smithi037 bash[9724]: cluster 2021-01-27T13:36:56.164737+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:57.682 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:57 smithi037 bash[13442]: cluster 2021-01-27T13:36:56.164737+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:58.054 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:36:57 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:36:58.072 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:36:57 smithi037 bash[9955]: debug 2021-01-27T13:36:57.679+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:36:58.653 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:58 smithi099 bash[9889]: audit 2021-01-27T13:36:57.682339+0000 mgr.y (mgr.14138) 338 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:58.672 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 3 2021-01-27T13:36:58.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:58 smithi037 bash[9724]: audit 2021-01-27T13:36:57.682339+0000 mgr.y (mgr.14138) 338 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:58.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:58 smithi037 bash[13442]: audit 2021-01-27T13:36:57.682339+0000 mgr.y (mgr.14138) 338 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:36:59.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.log pg_num 2021-01-27T13:36:59.648 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:36:59.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[9724]: cluster 2021-01-27T13:36:58.165711+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:59.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[9724]: audit 2021-01-27T13:36:58.599530+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:59.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[9724]: audit 2021-01-27T13:36:58.602777+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:59.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[9724]: audit 2021-01-27T13:36:58.603383+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:59.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[9724]: audit 2021-01-27T13:36:58.672681+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.37:0/2393974520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T13:36:59.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[13442]: cluster 2021-01-27T13:36:58.165711+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:59.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[13442]: audit 2021-01-27T13:36:58.599530+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:59.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[13442]: audit 2021-01-27T13:36:58.602777+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:59.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[13442]: audit 2021-01-27T13:36:58.603383+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:59.826 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:36:59 smithi037 bash[13442]: audit 2021-01-27T13:36:58.672681+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.37:0/2393974520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T13:36:59.914 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:36:59 smithi099 bash[24727]: t=2021-01-27T13:36:59+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-01-27T13:36:59.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:59 smithi099 bash[9889]: cluster 2021-01-27T13:36:58.165711+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:36:59.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:59 smithi099 bash[9889]: audit 2021-01-27T13:36:58.599530+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:36:59.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:59 smithi099 bash[9889]: audit 2021-01-27T13:36:58.602777+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:59.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:59 smithi099 bash[9889]: audit 2021-01-27T13:36:58.603383+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:36:59.916 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:36:59 smithi099 bash[9889]: audit 2021-01-27T13:36:58.672681+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.37:0/2393974520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T13:37:00.241 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:36:59 smithi099 bash[24727]: t=2021-01-27T13:36:59+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-01-27T13:37:00.241 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-01-27T13:37:00.241 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-01-27T13:37:00.552 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-01-27T13:37:00.552 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-01-27T13:37:00.552 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-01-27T13:37:00.552 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-01-27T13:37:00.810 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-27T13:37:00.810 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-01-27T13:37:00.811 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-01-27T13:37:00.811 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-01-27T13:37:01.113 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-01-27T13:37:01.114 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-01-27T13:37:01.114 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:00 smithi099 bash[24727]: t=2021-01-27T13:37:00+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-01-27T13:37:01.114 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-01-27T13:37:01.114 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-01-27T13:37:01.373 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-01-27T13:37:01.373 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-01-27T13:37:01.374 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-01-27T13:37:01.374 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-01-27T13:37:01.625 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-01-27T13:37:01.625 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-01-27T13:37:01.626 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-01-27T13:37:01.626 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-01-27T13:37:01.626 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cluster 2021-01-27T13:37:00.166763+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:01.626 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: audit 2021-01-27T13:37:00.614828+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:01.626 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:00.615837+0000 mgr.y (mgr.14138) 341 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:37:01.627 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: audit 2021-01-27T13:37:00.736459+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:01.627 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: audit 2021-01-27T13:37:01.040726+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:01.627 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.042560+0000 mgr.y (mgr.14138) 342 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:01.627 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.043384+0000 mgr.y (mgr.14138) 343 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:01.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.044124+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:01.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.045564+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:01.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.046825+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:01.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.047561+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:01.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.048171+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:01.629 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.049998+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T13:37:01.629 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[9889]: cephadm 2021-01-27T13:37:01.055410+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi037 2021-01-27T13:37:01.926 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-01-27T13:37:01.927 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-01-27T13:37:01.927 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-01-27T13:37:01.927 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-01-27T13:37:02.020 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cluster 2021-01-27T13:37:00.166763+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:02.020 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: audit 2021-01-27T13:37:00.614828+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:02.021 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:00.615837+0000 mgr.y (mgr.14138) 341 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:37:02.021 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: audit 2021-01-27T13:37:00.736459+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:02.021 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: audit 2021-01-27T13:37:01.040726+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:02.021 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.042560+0000 mgr.y (mgr.14138) 342 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:02.022 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.043384+0000 mgr.y (mgr.14138) 343 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:02.022 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.044124+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:02.022 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.045564+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:02.022 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.046825+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:02.023 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.047561+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:02.023 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.048171+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:02.023 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.049998+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T13:37:02.023 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[9724]: cephadm 2021-01-27T13:37:01.055410+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi037 2021-01-27T13:37:02.023 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cluster 2021-01-27T13:37:00.166763+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:02.024 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: audit 2021-01-27T13:37:00.614828+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:02.024 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:00.615837+0000 mgr.y (mgr.14138) 341 : cephadm [INF] refreshing smithi099 facts 2021-01-27T13:37:02.024 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: audit 2021-01-27T13:37:00.736459+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:02.024 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: audit 2021-01-27T13:37:01.040726+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:02.025 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.042560+0000 mgr.y (mgr.14138) 342 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:02.025 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.043384+0000 mgr.y (mgr.14138) 343 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:02.025 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.044124+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:02.025 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.045564+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:02.025 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.046825+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:02.026 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.047561+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:02.026 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.048171+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:02.026 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.049998+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T13:37:02.026 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:01 smithi037 bash[13442]: cephadm 2021-01-27T13:37:01.055410+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi037 2021-01-27T13:37:02.220 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:01 smithi099 bash[24727]: t=2021-01-27T13:37:01+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-01-27T13:37:02.220 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-01-27T13:37:02.220 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-01-27T13:37:02.220 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-01-27T13:37:02.521 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-01-27T13:37:02.522 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-01-27T13:37:02.522 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-01-27T13:37:02.789 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-01-27T13:37:02.790 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-01-27T13:37:02.790 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-01-27T13:37:03.057 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-01-27T13:37:03.058 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-01-27T13:37:03.058 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:02 smithi099 bash[24727]: t=2021-01-27T13:37:02+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-01-27T13:37:03.058 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-01-27T13:37:03.311 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-01-27T13:37:03.311 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-01-27T13:37:03.312 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-01-27T13:37:03.620 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-01-27T13:37:03.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-01-27T13:37:03.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-01-27T13:37:03.621 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-01-27T13:37:03.653 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:03 smithi037 bash[9724]: cluster 2021-01-27T13:37:02.167966+0000 mgr.y (mgr.14138) 351 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:03.654 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:03 smithi037 bash[13442]: cluster 2021-01-27T13:37:02.167966+0000 mgr.y (mgr.14138) 351 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:03.921 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[9889]: cluster 2021-01-27T13:37:02.167966+0000 mgr.y (mgr.14138) 351 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:03.921 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-01-27T13:37:03.922 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-01-27T13:37:03.922 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-01-27T13:37:03.923 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-01-27T13:37:03.975 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2021-01-27T13:37:04.214 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:03 smithi099 bash[24727]: t=2021-01-27T13:37:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-01-27T13:37:04.214 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-01-27T13:37:04.214 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-01-27T13:37:04.215 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-01-27T13:37:04.215 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-01-27T13:37:04.507 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-01-27T13:37:04.507 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-01-27T13:37:04.508 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-01-27T13:37:04.508 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-01-27T13:37:04.775 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[9889]: audit 2021-01-27T13:37:03.975984+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.37:0/1145729400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T13:37:04.776 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-01-27T13:37:04.776 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-01-27T13:37:04.777 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-01-27T13:37:04.777 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-01-27T13:37:04.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:04 smithi037 bash[9724]: audit 2021-01-27T13:37:03.975984+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.37:0/1145729400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T13:37:04.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:04 smithi037 bash[13442]: audit 2021-01-27T13:37:03.975984+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.37:0/1145729400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T13:37:05.060 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-01-27T13:37:05.312 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:04 smithi099 bash[24727]: t=2021-01-27T13:37:04+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-01-27T13:37:05.312 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-01-27T13:37:05.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.control pg_num 2021-01-27T13:37:05.345 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-01-27T13:37:05.346 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-01-27T13:37:05.346 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-01-27T13:37:05.347 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-01-27T13:37:05.474 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:05.613 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-01-27T13:37:05.613 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-01-27T13:37:05.614 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-01-27T13:37:05.614 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-01-27T13:37:05.614 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-01-27T13:37:05.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:05 smithi037 bash[9724]: cluster 2021-01-27T13:37:04.169016+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:05.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:05 smithi037 bash[13442]: cluster 2021-01-27T13:37:04.169016+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:05.889 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[9889]: cluster 2021-01-27T13:37:04.169016+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:05.890 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-27T13:37:05.890 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-01-27T13:37:05.890 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-01-27T13:37:06.174 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-01-27T13:37:06.174 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:05 smithi099 bash[24727]: t=2021-01-27T13:37:05+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-01-27T13:37:06.175 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-01-27T13:37:06.175 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-01-27T13:37:06.175 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-01-27T13:37:06.451 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-01-27T13:37:06.451 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-01-27T13:37:06.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-01-27T13:37:06.452 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-01-27T13:37:06.727 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-01-27T13:37:06.727 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-01-27T13:37:06.728 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-01-27T13:37:06.728 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-01-27T13:37:07.020 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-01-27T13:37:07.021 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-01-27T13:37:07.021 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:06 smithi099 bash[24727]: t=2021-01-27T13:37:06+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-01-27T13:37:07.021 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-01-27T13:37:07.310 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-01-27T13:37:07.311 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-01-27T13:37:07.311 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-01-27T13:37:07.590 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-01-27T13:37:07.590 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-01-27T13:37:07.590 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-01-27T13:37:07.591 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-01-27T13:37:07.591 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-01-27T13:37:07.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[9889]: cluster 2021-01-27T13:37:06.170166+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:07.842 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:37:07.842 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-01-27T13:37:07.843 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-01-27T13:37:07.843 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-01-27T13:37:08.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:07 smithi037 bash[9724]: cluster 2021-01-27T13:37:06.170166+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:08.073 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:37:07 smithi037 bash[9955]: debug 2021-01-27T13:37:07.687+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:37:08.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:07 smithi037 bash[13442]: cluster 2021-01-27T13:37:06.170166+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:08.093 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-01-27T13:37:08.093 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-01-27T13:37:08.093 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:07 smithi099 bash[24727]: t=2021-01-27T13:37:07+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-01-27T13:37:08.093 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-01-27T13:37:08.093 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-01-27T13:37:08.378 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-01-27T13:37:08.378 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-01-27T13:37:08.379 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-01-27T13:37:08.379 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-01-27T13:37:08.647 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-01-27T13:37:08.648 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-01-27T13:37:08.648 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-01-27T13:37:08.897 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[9889]: audit 2021-01-27T13:37:07.693560+0000 mgr.y (mgr.14138) 354 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:08.898 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-01-27T13:37:08.898 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-01-27T13:37:08.898 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-01-27T13:37:08.899 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-01-27T13:37:08.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:08 smithi037 bash[9724]: audit 2021-01-27T13:37:07.693560+0000 mgr.y (mgr.14138) 354 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:08.994 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:08 smithi037 bash[13442]: audit 2021-01-27T13:37:07.693560+0000 mgr.y (mgr.14138) 354 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:08.995 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:08 smithi037 systemd[1]: Stopping Ceph alertmanager.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c... 2021-01-27T13:37:09.182 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:08 smithi099 bash[24727]: t=2021-01-27T13:37:08+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-01-27T13:37:09.182 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-01-27T13:37:09.183 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-01-27T13:37:09.183 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-01-27T13:37:09.475 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-01-27T13:37:09.476 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-01-27T13:37:09.476 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-01-27T13:37:09.476 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-01-27T13:37:09.649 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:09 smithi037 bash[26510]: level=info ts=2021-01-27T13:37:09.344Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-01-27T13:37:09.727 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[9889]: cluster 2021-01-27T13:37:08.171088+0000 mgr.y (mgr.14138) 355 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:09.727 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-01-27T13:37:09.727 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-01-27T13:37:09.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:09 smithi037 bash[9724]: cluster 2021-01-27T13:37:08.171088+0000 mgr.y (mgr.14138) 355 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:09.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:09 smithi037 bash[13442]: cluster 2021-01-27T13:37:08.171088+0000 mgr.y (mgr.14138) 355 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:10.037 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-01-27T13:37:10.037 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-01-27T13:37:10.037 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-01-27T13:37:10.037 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:09 smithi099 bash[24727]: t=2021-01-27T13:37:09+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-01-27T13:37:10.038 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-01-27T13:37:10.305 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-01-27T13:37:10.305 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-01-27T13:37:10.305 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-01-27T13:37:10.306 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-01-27T13:37:10.560 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-01-27T13:37:10.561 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-01-27T13:37:10.561 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-01-27T13:37:10.866 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-01-27T13:37:10.867 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-01-27T13:37:10.867 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-01-27T13:37:10.867 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-01-27T13:37:10.867 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-01-27T13:37:11.151 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:10 smithi099 bash[24727]: t=2021-01-27T13:37:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-01-27T13:37:11.152 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[24727]: t=2021-01-27T13:37:11+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-01-27T13:37:11.152 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[24727]: t=2021-01-27T13:37:11+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-01-27T13:37:11.280 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2021-01-27T13:37:11.323 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:10 smithi037 docker[28132]: ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c-alertmanager.a 2021-01-27T13:37:11.323 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:10 smithi037 systemd[1]: ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@alertmanager.a.service: Succeeded. 2021-01-27T13:37:11.323 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:10 smithi037 systemd[1]: Stopped Ceph alertmanager.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:37:11.323 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:10 smithi037 systemd[1]: Started Ceph alertmanager.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:37:11.412 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[24727]: t=2021-01-27T13:37:11+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-01-27T13:37:11.413 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[24727]: t=2021-01-27T13:37:11+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-01-27T13:37:11.413 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[24727]: t=2021-01-27T13:37:11+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-01-27T13:37:11.413 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[24727]: t=2021-01-27T13:37:11+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-01-27T13:37:11.951 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[24727]: t=2021-01-27T13:37:11+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-01-27T13:37:11.951 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[24727]: t=2021-01-27T13:37:11+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-01-27T13:37:11.990 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[13442]: cluster 2021-01-27T13:37:10.172348+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:11.990 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[13442]: audit 2021-01-27T13:37:10.949688+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:11.991 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[13442]: cephadm 2021-01-27T13:37:10.952445+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T13:37:11.991 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[13442]: cephadm 2021-01-27T13:37:10.957185+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi099 2021-01-27T13:37:11.991 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[13442]: audit 2021-01-27T13:37:11.280972+0000 mon.a (mon.0) 630 : audit [DBG] from='client.? 172.21.15.37:0/1324707011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T13:37:11.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[9724]: cluster 2021-01-27T13:37:10.172348+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:11.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[9724]: audit 2021-01-27T13:37:10.949688+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:11.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[9724]: cephadm 2021-01-27T13:37:10.952445+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T13:37:11.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[9724]: cephadm 2021-01-27T13:37:10.957185+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi099 2021-01-27T13:37:11.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:11 smithi037 bash[9724]: audit 2021-01-27T13:37:11.280972+0000 mon.a (mon.0) 630 : audit [DBG] from='client.? 172.21.15.37:0/1324707011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T13:37:12.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[9889]: cluster 2021-01-27T13:37:10.172348+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:12.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[9889]: audit 2021-01-27T13:37:10.949688+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:12.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[9889]: cephadm 2021-01-27T13:37:10.952445+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T13:37:12.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[9889]: cephadm 2021-01-27T13:37:10.957185+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi099 2021-01-27T13:37:12.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:11 smithi099 bash[9889]: audit 2021-01-27T13:37:11.280972+0000 mon.a (mon.0) 630 : audit [DBG] from='client.? 172.21.15.37:0/1324707011' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T13:37:12.519 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:12 smithi099 bash[24727]: t=2021-01-27T13:37:12+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-01-27T13:37:12.519 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:12 smithi099 bash[24727]: t=2021-01-27T13:37:12+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-01-27T13:37:12.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.meta pg_num 2021-01-27T13:37:12.810 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:12 smithi099 bash[24727]: t=2021-01-27T13:37:12+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-01-27T13:37:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:13.294 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-01-27T13:37:13.294 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-01-27T13:37:13.560 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-01-27T13:37:13.561 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-01-27T13:37:13.822 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-01-27T13:37:13.822 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-01-27T13:37:13.822 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-01-27T13:37:13.823 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:13.415Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-27T13:37:13.823 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:13.415Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-27T13:37:13.823 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:13.418Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.37 port=9094 2021-01-27T13:37:13.824 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:13.420Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-27T13:37:13.824 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:13.460Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T13:37:13.824 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:13.460Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T13:37:13.824 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:13.466Z caller=main.go:497 msg=Listening address=:9093 2021-01-27T13:37:14.099 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[9889]: cluster 2021-01-27T13:37:12.173562+0000 mgr.y (mgr.14138) 359 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:14.099 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-01-27T13:37:14.099 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:13 smithi099 bash[24727]: t=2021-01-27T13:37:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-01-27T13:37:14.100 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:14 smithi099 bash[24727]: t=2021-01-27T13:37:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-01-27T13:37:14.298 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[13442]: cluster 2021-01-27T13:37:12.173562+0000 mgr.y (mgr.14138) 359 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:14.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:13 smithi037 bash[9724]: cluster 2021-01-27T13:37:12.173562+0000 mgr.y (mgr.14138) 359 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:14.810 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:14 smithi099 bash[24727]: t=2021-01-27T13:37:14+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-01-27T13:37:14.811 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:14 smithi099 bash[24727]: t=2021-01-27T13:37:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-01-27T13:37:15.280 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:14 smithi037 bash[9724]: audit 2021-01-27T13:37:14.277393+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:37:15.281 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:14 smithi037 bash[9724]: audit 2021-01-27T13:37:14.278245+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:37:15.281 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:14 smithi037 bash[13442]: audit 2021-01-27T13:37:14.277393+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:37:15.281 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:14 smithi037 bash[13442]: audit 2021-01-27T13:37:14.278245+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:37:15.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:14 smithi099 bash[9889]: audit 2021-01-27T13:37:14.277393+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:37:15.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:14 smithi099 bash[9889]: audit 2021-01-27T13:37:14.278245+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:37:15.311 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:14 smithi099 bash[24727]: t=2021-01-27T13:37:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-01-27T13:37:15.311 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:14 smithi099 bash[24727]: t=2021-01-27T13:37:14+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-01-27T13:37:15.573 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:15 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:15.420Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000176788s 2021-01-27T13:37:15.688 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:15 smithi099 bash[24727]: t=2021-01-27T13:37:15+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-01-27T13:37:15.689 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:15 smithi099 bash[24727]: t=2021-01-27T13:37:15+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-01-27T13:37:15.689 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:15 smithi099 bash[24727]: t=2021-01-27T13:37:15+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-01-27T13:37:16.292 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:15 smithi099 bash[9889]: cluster 2021-01-27T13:37:14.174653+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:16.293 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:16 smithi099 bash[24727]: t=2021-01-27T13:37:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-01-27T13:37:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:15 smithi037 bash[9724]: cluster 2021-01-27T13:37:14.174653+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:16.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:15 smithi037 bash[13442]: cluster 2021-01-27T13:37:14.174653+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:16.560 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:16 smithi099 bash[24727]: t=2021-01-27T13:37:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-01-27T13:37:16.561 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:16 smithi099 bash[24727]: t=2021-01-27T13:37:16+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-01-27T13:37:16.715 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2021-01-27T13:37:16.921 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:16 smithi099 bash[24727]: t=2021-01-27T13:37:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-01-27T13:37:16.922 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:16 smithi099 bash[24727]: t=2021-01-27T13:37:16+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-01-27T13:37:16.922 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:16 smithi099 bash[24727]: t=2021-01-27T13:37:16+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-01-27T13:37:16.922 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:16 smithi099 bash[24727]: t=2021-01-27T13:37:16+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-01-27T13:37:17.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:16 smithi037 bash[9724]: audit 2021-01-27T13:37:16.715479+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.37:0/1429425556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T13:37:17.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:16 smithi037 bash[13442]: audit 2021-01-27T13:37:16.715479+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.37:0/1429425556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T13:37:17.184 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:16 smithi099 bash[9889]: audit 2021-01-27T13:37:16.715479+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.37:0/1429425556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T13:37:17.185 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:17 smithi099 bash[24727]: t=2021-01-27T13:37:17+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-01-27T13:37:17.557 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-01-27T13:37:17.558 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-01-27T13:37:17.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph mgr dump --format=json 2021-01-27T13:37:17.560 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:17 smithi099 bash[24727]: t=2021-01-27T13:37:17+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-01-27T13:37:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:17.823 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:37:17 smithi037 bash[9955]: debug 2021-01-27T13:37:17.699+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:37:17.850 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:37:17 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:37:17.850 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:17 smithi099 bash[24727]: t=2021-01-27T13:37:17+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-01-27T13:37:17.851 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:17 smithi099 bash[24727]: t=2021-01-27T13:37:17+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-01-27T13:37:18.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:17 smithi037 bash[9724]: cluster 2021-01-27T13:37:16.175783+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:18.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:17 smithi037 bash[13442]: cluster 2021-01-27T13:37:16.175783+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:18.160 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:17 smithi099 systemd[1]: Stopping Ceph prometheus.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c... 2021-01-27T13:37:18.161 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:17 smithi099 bash[9889]: cluster 2021-01-27T13:37:16.175783+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:18.161 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:17 smithi099 bash[24727]: t=2021-01-27T13:37:17+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-01-27T13:37:18.162 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:17 smithi099 bash[24727]: t=2021-01-27T13:37:17+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-01-27T13:37:18.162 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[24727]: t=2021-01-27T13:37:18+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-01-27T13:37:18.430 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[24727]: t=2021-01-27T13:37:18+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-01-27T13:37:18.431 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[24727]: t=2021-01-27T13:37:18+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-01-27T13:37:18.431 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=warn ts=2021-01-27T13:37:18.161Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-01-27T13:37:18.431 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.161Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-01-27T13:37:18.431 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.161Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-01-27T13:37:18.432 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.161Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-01-27T13:37:18.432 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.161Z caller=main.go:583 msg="Stopping scrape manager..." 2021-01-27T13:37:18.432 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.162Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-01-27T13:37:18.432 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.162Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-01-27T13:37:18.433 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.162Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-01-27T13:37:18.433 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.162Z caller=main.go:577 msg="Scrape manager stopped" 2021-01-27T13:37:18.433 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.162Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-01-27T13:37:18.433 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.162Z caller=main.go:749 msg="Notifier manager stopped" 2021-01-27T13:37:18.433 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[23354]: level=info ts=2021-01-27T13:37:18.162Z caller=main.go:761 msg="See you next time!" 2021-01-27T13:37:18.808 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[24727]: t=2021-01-27T13:37:18+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-01-27T13:37:19.060 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[9889]: audit 2021-01-27T13:37:17.703254+0000 mgr.y (mgr.14138) 362 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:19.061 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:18 smithi099 bash[24727]: t=2021-01-27T13:37:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-01-27T13:37:19.145 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:18 smithi037 bash[9724]: audit 2021-01-27T13:37:17.703254+0000 mgr.y (mgr.14138) 362 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:19.147 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:18 smithi037 bash[13442]: audit 2021-01-27T13:37:17.703254+0000 mgr.y (mgr.14138) 362 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:19.359 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:19 smithi099 docker[25331]: ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c-prometheus.a 2021-01-27T13:37:19.359 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:19 smithi099 systemd[1]: ceph-8e2eaa02-60a3-11eb-8f9a-001a4aab830c@prometheus.a.service: Succeeded. 2021-01-27T13:37:19.360 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:19 smithi099 systemd[1]: Stopped Ceph prometheus.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:37:19.360 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:19 smithi099 systemd[1]: Started Ceph prometheus.a for 8e2eaa02-60a3-11eb-8f9a-001a4aab830c. 2021-01-27T13:37:19.361 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[24727]: t=2021-01-27T13:37:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-01-27T13:37:19.361 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[24727]: t=2021-01-27T13:37:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-01-27T13:37:19.810 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[24727]: t=2021-01-27T13:37:19+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-01-27T13:37:19.811 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[24727]: t=2021-01-27T13:37:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-01-27T13:37:20.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: cluster 2021-01-27T13:37:18.176722+0000 mgr.y (mgr.14138) 363 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:20.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.325168+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.333722+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T13:37:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.336298+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2021-01-27T13:37:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.344121+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.350117+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T13:37:20.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.358217+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099:9095"}]: dispatch 2021-01-27T13:37:20.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.367399+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.373569+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T13:37:20.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.384417+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099:3000"}]: dispatch 2021-01-27T13:37:20.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.391073+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.396324+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:37:20.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[9724]: audit 2021-01-27T13:37:19.397087+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:37:20.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: cluster 2021-01-27T13:37:18.176722+0000 mgr.y (mgr.14138) 363 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:20.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.325168+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.333722+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T13:37:20.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.336298+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2021-01-27T13:37:20.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.344121+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.350117+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T13:37:20.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.358217+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099:9095"}]: dispatch 2021-01-27T13:37:20.078 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.367399+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.078 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.373569+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T13:37:20.078 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.384417+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099:3000"}]: dispatch 2021-01-27T13:37:20.079 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.391073+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.079 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.396324+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:37:20.079 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:19 smithi037 bash[13442]: audit 2021-01-27T13:37:19.397087+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:37:20.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: cluster 2021-01-27T13:37:18.176722+0000 mgr.y (mgr.14138) 363 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:20.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.325168+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.333722+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T13:37:20.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.336298+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2021-01-27T13:37:20.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.344121+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.350117+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T13:37:20.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.358217+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099:9095"}]: dispatch 2021-01-27T13:37:20.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.367399+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.373569+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T13:37:20.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.384417+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099:3000"}]: dispatch 2021-01-27T13:37:20.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.391073+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:20.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.396324+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:37:20.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:19 smithi099 bash[9889]: audit 2021-01-27T13:37:19.397087+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T13:37:20.316 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:20 smithi099 bash[24727]: t=2021-01-27T13:37:20+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-01-27T13:37:20.316 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:20 smithi099 bash[24727]: t=2021-01-27T13:37:20+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-01-27T13:37:20.672 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:20 smithi099 bash[24727]: t=2021-01-27T13:37:20+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-01-27T13:37:20.937 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:20 smithi099 bash[24727]: t=2021-01-27T13:37:20+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-01-27T13:37:20.937 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:20 smithi099 bash[24727]: t=2021-01-27T13:37:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-01-27T13:37:21.224 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-01-27T13:37:21.224 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[9889]: audit 2021-01-27T13:37:19.334572+0000 mgr.y (mgr.14138) 364 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T13:37:21.225 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[9889]: audit 2021-01-27T13:37:19.337009+0000 mgr.y (mgr.14138) 365 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2021-01-27T13:37:21.225 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[9889]: audit 2021-01-27T13:37:19.350832+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T13:37:21.225 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[9889]: audit 2021-01-27T13:37:19.358809+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099:9095"}]: dispatch 2021-01-27T13:37:21.225 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[9889]: audit 2021-01-27T13:37:19.374197+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T13:37:21.226 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[9889]: audit 2021-01-27T13:37:19.384956+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099:3000"}]: dispatch 2021-01-27T13:37:21.308 INFO:teuthology.orchestra.run.smithi037.stdout: 2021-01-27T13:37:21.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[9724]: audit 2021-01-27T13:37:19.334572+0000 mgr.y (mgr.14138) 364 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T13:37:21.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[9724]: audit 2021-01-27T13:37:19.337009+0000 mgr.y (mgr.14138) 365 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2021-01-27T13:37:21.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[9724]: audit 2021-01-27T13:37:19.350832+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T13:37:21.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[9724]: audit 2021-01-27T13:37:19.358809+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099:9095"}]: dispatch 2021-01-27T13:37:21.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[9724]: audit 2021-01-27T13:37:19.374197+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T13:37:21.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[9724]: audit 2021-01-27T13:37:19.384956+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099:3000"}]: dispatch 2021-01-27T13:37:21.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[13442]: audit 2021-01-27T13:37:19.334572+0000 mgr.y (mgr.14138) 364 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T13:37:21.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[13442]: audit 2021-01-27T13:37:19.337009+0000 mgr.y (mgr.14138) 365 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2021-01-27T13:37:21.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[13442]: audit 2021-01-27T13:37:19.350832+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T13:37:21.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[13442]: audit 2021-01-27T13:37:19.358809+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099:9095"}]: dispatch 2021-01-27T13:37:21.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[13442]: audit 2021-01-27T13:37:19.374197+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T13:37:21.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:21 smithi037 bash[13442]: audit 2021-01-27T13:37:19.384956+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099:3000"}]: dispatch 2021-01-27T13:37:21.530 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-01-27T13:37:21.530 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-01-27T13:37:21.531 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-01-27T13:37:21.812 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-01-27T13:37:21.812 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-01-27T13:37:21.813 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-01-27T13:37:21.813 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-01-27T13:37:21.813 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.531Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-01-27T13:37:21.813 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.531Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-01-27T13:37:21.813 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.531Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-01-27T13:37:21.814 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.531Z caller=main.go:339 host_details="(Linux 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 smithi099 (none))" 2021-01-27T13:37:21.814 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.531Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-01-27T13:37:21.814 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.531Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-01-27T13:37:21.814 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.533Z caller=main.go:678 msg="Starting TSDB ..." 2021-01-27T13:37:21.815 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.533Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-01-27T13:37:21.815 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.539Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-01-27T13:37:21.815 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.540Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-01-27T13:37:21.815 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.541Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-01-27T13:37:21.815 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.541Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=2.053ms 2021-01-27T13:37:21.816 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.543Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-01-27T13:37:21.816 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.543Z caller=main.go:695 msg="TSDB started" 2021-01-27T13:37:21.816 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.543Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T13:37:21.816 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.544Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T13:37:21.816 INFO:journalctl@ceph.prometheus.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[25378]: level=info ts=2021-01-27T13:37:21.544Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-27T13:37:22.113 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":15,"active_gid":14138,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1075678879},{"type":"v1","addr":"172.21.15.37:6801","nonce":1075678879}]},"active_addr":"172.21.15.37:6801/1075678879","active_change":"2021-01-27T13:30:13.087920+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi037.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1276423195}]},{"addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2739837563}]},{"addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2206968109}]}]}} 2021-01-27T13:37:22.118 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-01-27T13:37:22.118 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-01-27T13:37:22.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T13:37:22.132 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-01-27T13:37:22.132 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-01-27T13:37:22.133 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:21 smithi099 bash[24727]: t=2021-01-27T13:37:21+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-01-27T13:37:22.133 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-01-27T13:37:22.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[9889]: cluster 2021-01-27T13:37:20.177477+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:22.134 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[9889]: audit 2021-01-27T13:37:21.066274+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:22.134 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[9889]: audit 2021-01-27T13:37:21.297851+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.37:0/1879768824' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T13:37:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:22.318 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:22 smithi037 bash[13442]: cluster 2021-01-27T13:37:20.177477+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:22.318 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:22 smithi037 bash[13442]: audit 2021-01-27T13:37:21.066274+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:22.318 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:22 smithi037 bash[13442]: audit 2021-01-27T13:37:21.297851+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.37:0/1879768824' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T13:37:22.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:22 smithi037 bash[9724]: cluster 2021-01-27T13:37:20.177477+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:22.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:22 smithi037 bash[9724]: audit 2021-01-27T13:37:21.066274+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:22.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:22 smithi037 bash[9724]: audit 2021-01-27T13:37:21.297851+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.37:0/1879768824' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T13:37:22.400 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-01-27T13:37:22.401 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-01-27T13:37:22.401 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-01-27T13:37:22.401 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-01-27T13:37:22.401 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-01-27T13:37:22.669 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-01-27T13:37:22.669 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-01-27T13:37:22.669 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-01-27T13:37:22.670 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-01-27T13:37:23.020 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-01-27T13:37:23.021 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:22 smithi099 bash[24727]: t=2021-01-27T13:37:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-01-27T13:37:23.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cluster 2021-01-27T13:37:22.178613+0000 mgr.y (mgr.14138) 371 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:23.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: audit 2021-01-27T13:37:22.259757+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: audit 2021-01-27T13:37:22.266712+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.267874+0000 mgr.y (mgr.14138) 372 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:23.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.268840+0000 mgr.y (mgr.14138) 373 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:23.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.269445+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:23.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.270060+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.270653+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:23.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.271283+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.271897+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: audit 2021-01-27T13:37:22.280839+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.282344+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:23.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.283488+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:23.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.284453+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:23.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.285407+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.286404+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:23.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.287360+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[9889]: cephadm 2021-01-27T13:37:22.288299+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.315 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-01-27T13:37:23.315 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-01-27T13:37:23.315 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-01-27T13:37:23.316 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-01-27T13:37:23.316 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-01-27T13:37:23.316 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-01-27T13:37:23.316 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-01-27T13:37:23.316 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing HooksService" logger=server 2021-01-27T13:37:23.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-01-27T13:37:23.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-01-27T13:37:23.317 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-01-27T13:37:23.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-01-27T13:37:23.318 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-01-27T13:37:23.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-01-27T13:37:23.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-01-27T13:37:23.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-01-27T13:37:23.319 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-01-27T13:37:23.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing LoginService" logger=server 2021-01-27T13:37:23.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing SearchService" logger=server 2021-01-27T13:37:23.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing TracingService" logger=server 2021-01-27T13:37:23.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-01-27T13:37:23.320 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-01-27T13:37:23.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-01-27T13:37:23.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-01-27T13:37:23.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-01-27T13:37:23.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-01-27T13:37:23.321 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-01-27T13:37:23.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-01-27T13:37:23.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="Initializing Stream Manager" 2021-01-27T13:37:23.322 INFO:journalctl@ceph.grafana.a.smithi099.stdout:Jan 27 13:37:23 smithi099 bash[24727]: t=2021-01-27T13:37:23+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-01-27T13:37:23.573 INFO:journalctl@ceph.alertmanager.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[28208]: level=info ts=2021-01-27T13:37:23.421Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000845428s 2021-01-27T13:37:23.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cluster 2021-01-27T13:37:22.178613+0000 mgr.y (mgr.14138) 371 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:23.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: audit 2021-01-27T13:37:22.259757+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: audit 2021-01-27T13:37:22.266712+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.267874+0000 mgr.y (mgr.14138) 372 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:23.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.268840+0000 mgr.y (mgr.14138) 373 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:23.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.269445+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:23.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.270060+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.270653+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:23.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.271283+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.271897+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: audit 2021-01-27T13:37:22.280839+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.282344+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:23.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.283488+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:23.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.284453+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:23.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.285407+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.286404+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:23.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.287360+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.577 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[13442]: cephadm 2021-01-27T13:37:22.288299+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cluster 2021-01-27T13:37:22.178613+0000 mgr.y (mgr.14138) 371 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:23.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: audit 2021-01-27T13:37:22.259757+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: audit 2021-01-27T13:37:22.266712+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.267874+0000 mgr.y (mgr.14138) 372 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:23.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.268840+0000 mgr.y (mgr.14138) 373 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:23.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.269445+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:23.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.270060+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.270653+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:23.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.271283+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.271897+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: audit 2021-01-27T13:37:22.280839+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' 2021-01-27T13:37:23.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.282344+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='y'), HostPlacementSpec(hostname='smithi099', network='', name='x')] + new hosts [] 2021-01-27T13:37:23.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.283488+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T13:37:23.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.284453+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='iscsi.a')] + new hosts [] 2021-01-27T13:37:23.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.285407+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.286404+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a'), HostPlacementSpec(hostname='smithi099', network='', name='b')] + new hosts [] 2021-01-27T13:37:23.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.287360+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi037', network='', name='a')] + new hosts [] 2021-01-27T13:37:23.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:23 smithi037 bash[9724]: cephadm 2021-01-27T13:37:22.288299+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi099', network='', name='a')] + new hosts [] 2021-01-27T13:37:25.522 INFO:teuthology.orchestra.run.smithi037.stdout: 2021-01-27T13:37:25.523 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"fsid":"8e2eaa02-60a3-11eb-8f9a-001a4aab830c","created":"2021-01-27T13:29:19.043116+0000","modified":"2021-01-27T13:36:15.909371+0000","last_up_change":"2021-01-27T13:35:38.158909+0000","last_in_change":"2021-01-27T13:35:38.158909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T13:31:06.746921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T13:35:33.629522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T13:35:51.717224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T13:35:53.332662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T13:35:55.249321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T13:35:58.444028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"93075704-87a9-40ed-b48b-0f0d6d82e21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6803","nonce":3717584473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6805","nonce":3717584473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6809","nonce":3717584473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6807","nonce":3717584473}]},"public_addr":"172.21.15.37:6803/3717584473","cluster_addr":"172.21.15.37:6805/3717584473","heartbeat_back_addr":"172.21.15.37:6809/3717584473","heartbeat_front_addr":"172.21.15.37:6807/3717584473","state":["exists","up"]},{"osd":1,"uuid":"ce5756c1-c1b8-45c7-b29e-290411342ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6811","nonce":2975719624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6813","nonce":2975719624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6817","nonce":2975719624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6815","nonce":2975719624}]},"public_addr":"172.21.15.37:6811/2975719624","cluster_addr":"172.21.15.37:6813/2975719624","heartbeat_back_addr":"172.21.15.37:6817/2975719624","heartbeat_front_addr":"172.21.15.37:6815/2975719624","state":["exists","up"]},{"osd":2,"uuid":"a6eecd04-669c-4e2b-adc6-d13bf2367c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6819","nonce":3212740438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6821","nonce":3212740438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6825","nonce":3212740438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6823","nonce":3212740438}]},"public_addr":"172.21.15.37:6819/3212740438","cluster_addr":"172.21.15.37:6821/3212740438","heartbeat_back_addr":"172.21.15.37:6825/3212740438","heartbeat_front_addr":"172.21.15.37:6823/3212740438","state":["exists","up"]},{"osd":3,"uuid":"3bceaf77-1be5-46e0-8259-91102f1a4992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6827","nonce":4063867695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6829","nonce":4063867695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6833","nonce":4063867695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6831","nonce":4063867695}]},"public_addr":"172.21.15.37:6827/4063867695","cluster_addr":"172.21.15.37:6829/4063867695","heartbeat_back_addr":"172.21.15.37:6833/4063867695","heartbeat_front_addr":"172.21.15.37:6831/4063867695","state":["exists","up"]},{"osd":4,"uuid":"ea105ac4-1f5c-4633-ab72-7f98b4f2b71c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6801","nonce":2470343434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6803","nonce":2470343434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6807","nonce":2470343434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6805","nonce":2470343434}]},"public_addr":"172.21.15.99:6801/2470343434","cluster_addr":"172.21.15.99:6803/2470343434","heartbeat_back_addr":"172.21.15.99:6807/2470343434","heartbeat_front_addr":"172.21.15.99:6805/2470343434","state":["exists","up"]},{"osd":5,"uuid":"1fc3490c-96bc-4df1-90aa-a4752db114f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6809","nonce":1575468921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6811","nonce":1575468921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6815","nonce":1575468921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6813","nonce":1575468921}]},"public_addr":"172.21.15.99:6809/1575468921","cluster_addr":"172.21.15.99:6811/1575468921","heartbeat_back_addr":"172.21.15.99:6815/1575468921","heartbeat_front_addr":"172.21.15.99:6813/1575468921","state":["exists","up"]},{"osd":6,"uuid":"99cbcbe8-43df-4778-ab84-4605193bd31c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6817","nonce":2481050874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6819","nonce":2481050874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6823","nonce":2481050874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6821","nonce":2481050874}]},"public_addr":"172.21.15.99:6817/2481050874","cluster_addr":"172.21.15.99:6819/2481050874","heartbeat_back_addr":"172.21.15.99:6823/2481050874","heartbeat_front_addr":"172.21.15.99:6821/2481050874","state":["exists","up"]},{"osd":7,"uuid":"d497a0c5-50a0-45b0-83e6-1058a44038c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6825","nonce":888607185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6827","nonce":888607185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6831","nonce":888607185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6829","nonce":888607185}]},"public_addr":"172.21.15.99:6825/888607185","cluster_addr":"172.21.15.99:6827/888607185","heartbeat_back_addr":"172.21.15.99:6831/888607185","heartbeat_front_addr":"172.21.15.99:6829/888607185","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:32:26.313554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:32:55.954782+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:33:25.389717+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:33:53.032284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:34:17.196786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:34:43.904841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:35:09.799732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:35:36.504895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":7,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2834625275":"2021-01-28T13:30:13.087341+0000","172.21.15.37:6800/2834625275":"2021-01-28T13:30:13.087341+0000","172.21.15.37:0/4030211386":"2021-01-28T13:30:13.087341+0000","172.21.15.37:0/588400976":"2021-01-28T13:29:50.235508+0000","172.21.15.37:0/3061529231":"2021-01-28T13:29:50.235508+0000","172.21.15.37:6800/2077595097":"2021-01-28T13:29:50.235508+0000","172.21.15.37:0/2633512979":"2021-01-28T13:30:13.087341+0000","172.21.15.37:6801/2077595097":"2021-01-28T13:29:50.235508+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T13:37:25.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:25 smithi099 bash[9889]: cluster 2021-01-27T13:37:24.179691+0000 mgr.y (mgr.14138) 386 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:25.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:25 smithi037 bash[9724]: cluster 2021-01-27T13:37:24.179691+0000 mgr.y (mgr.14138) 386 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:25.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:25 smithi037 bash[13442]: cluster 2021-01-27T13:37:24.179691+0000 mgr.y (mgr.14138) 386 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:26.328 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-01-27T13:37:26.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T13:37:26.480 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:26.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:26 smithi099 bash[9889]: audit 2021-01-27T13:37:25.521730+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.37:0/78742719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:37:26.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:26 smithi037 bash[9724]: audit 2021-01-27T13:37:25.521730+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.37:0/78742719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:37:26.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:26 smithi037 bash[13442]: audit 2021-01-27T13:37:25.521730+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.37:0/78742719' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:37:27.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:27 smithi037 bash[9724]: cluster 2021-01-27T13:37:26.180836+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:27.683 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:27 smithi037 bash[13442]: cluster 2021-01-27T13:37:26.180836+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:27.814 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:37:27 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:37:27.814 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:27 smithi099 bash[9889]: cluster 2021-01-27T13:37:26.180836+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:28.075 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:37:27 smithi037 bash[9955]: debug 2021-01-27T13:37:27.706+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:37:28.635 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:28 smithi037 bash[9724]: audit 2021-01-27T13:37:27.711357+0000 mgr.y (mgr.14138) 388 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:28.636 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:28 smithi037 bash[13442]: audit 2021-01-27T13:37:27.711357+0000 mgr.y (mgr.14138) 388 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:28.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:28 smithi099 bash[9889]: audit 2021-01-27T13:37:27.711357+0000 mgr.y (mgr.14138) 388 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:29.776 INFO:teuthology.orchestra.run.smithi037.stdout: 2021-01-27T13:37:29.776 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"fsid":"8e2eaa02-60a3-11eb-8f9a-001a4aab830c","created":"2021-01-27T13:29:19.043116+0000","modified":"2021-01-27T13:36:15.909371+0000","last_up_change":"2021-01-27T13:35:38.158909+0000","last_in_change":"2021-01-27T13:35:38.158909+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T13:31:06.746921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T13:35:33.629522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T13:35:51.717224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T13:35:53.332662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T13:35:55.249321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T13:35:58.444028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"93075704-87a9-40ed-b48b-0f0d6d82e21a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6803","nonce":3717584473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6805","nonce":3717584473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6809","nonce":3717584473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3717584473},{"type":"v1","addr":"172.21.15.37:6807","nonce":3717584473}]},"public_addr":"172.21.15.37:6803/3717584473","cluster_addr":"172.21.15.37:6805/3717584473","heartbeat_back_addr":"172.21.15.37:6809/3717584473","heartbeat_front_addr":"172.21.15.37:6807/3717584473","state":["exists","up"]},{"osd":1,"uuid":"ce5756c1-c1b8-45c7-b29e-290411342ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6811","nonce":2975719624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6813","nonce":2975719624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6817","nonce":2975719624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2975719624},{"type":"v1","addr":"172.21.15.37:6815","nonce":2975719624}]},"public_addr":"172.21.15.37:6811/2975719624","cluster_addr":"172.21.15.37:6813/2975719624","heartbeat_back_addr":"172.21.15.37:6817/2975719624","heartbeat_front_addr":"172.21.15.37:6815/2975719624","state":["exists","up"]},{"osd":2,"uuid":"a6eecd04-669c-4e2b-adc6-d13bf2367c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6819","nonce":3212740438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6821","nonce":3212740438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6825","nonce":3212740438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3212740438},{"type":"v1","addr":"172.21.15.37:6823","nonce":3212740438}]},"public_addr":"172.21.15.37:6819/3212740438","cluster_addr":"172.21.15.37:6821/3212740438","heartbeat_back_addr":"172.21.15.37:6825/3212740438","heartbeat_front_addr":"172.21.15.37:6823/3212740438","state":["exists","up"]},{"osd":3,"uuid":"3bceaf77-1be5-46e0-8259-91102f1a4992","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6827","nonce":4063867695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6829","nonce":4063867695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6833","nonce":4063867695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":4063867695},{"type":"v1","addr":"172.21.15.37:6831","nonce":4063867695}]},"public_addr":"172.21.15.37:6827/4063867695","cluster_addr":"172.21.15.37:6829/4063867695","heartbeat_back_addr":"172.21.15.37:6833/4063867695","heartbeat_front_addr":"172.21.15.37:6831/4063867695","state":["exists","up"]},{"osd":4,"uuid":"ea105ac4-1f5c-4633-ab72-7f98b4f2b71c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6801","nonce":2470343434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6803","nonce":2470343434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6807","nonce":2470343434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2470343434},{"type":"v1","addr":"172.21.15.99:6805","nonce":2470343434}]},"public_addr":"172.21.15.99:6801/2470343434","cluster_addr":"172.21.15.99:6803/2470343434","heartbeat_back_addr":"172.21.15.99:6807/2470343434","heartbeat_front_addr":"172.21.15.99:6805/2470343434","state":["exists","up"]},{"osd":5,"uuid":"1fc3490c-96bc-4df1-90aa-a4752db114f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6809","nonce":1575468921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6811","nonce":1575468921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6815","nonce":1575468921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1575468921},{"type":"v1","addr":"172.21.15.99:6813","nonce":1575468921}]},"public_addr":"172.21.15.99:6809/1575468921","cluster_addr":"172.21.15.99:6811/1575468921","heartbeat_back_addr":"172.21.15.99:6815/1575468921","heartbeat_front_addr":"172.21.15.99:6813/1575468921","state":["exists","up"]},{"osd":6,"uuid":"99cbcbe8-43df-4778-ab84-4605193bd31c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6817","nonce":2481050874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6819","nonce":2481050874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6823","nonce":2481050874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2481050874},{"type":"v1","addr":"172.21.15.99:6821","nonce":2481050874}]},"public_addr":"172.21.15.99:6817/2481050874","cluster_addr":"172.21.15.99:6819/2481050874","heartbeat_back_addr":"172.21.15.99:6823/2481050874","heartbeat_front_addr":"172.21.15.99:6821/2481050874","state":["exists","up"]},{"osd":7,"uuid":"d497a0c5-50a0-45b0-83e6-1058a44038c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6825","nonce":888607185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6827","nonce":888607185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6831","nonce":888607185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":888607185},{"type":"v1","addr":"172.21.15.99:6829","nonce":888607185}]},"public_addr":"172.21.15.99:6825/888607185","cluster_addr":"172.21.15.99:6827/888607185","heartbeat_back_addr":"172.21.15.99:6831/888607185","heartbeat_front_addr":"172.21.15.99:6829/888607185","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:32:26.313554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:32:55.954782+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:33:25.389717+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:33:53.032284+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:34:17.196786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:34:43.904841+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:35:09.799732+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T13:35:36.504895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":7,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/2834625275":"2021-01-28T13:30:13.087341+0000","172.21.15.37:6800/2834625275":"2021-01-28T13:30:13.087341+0000","172.21.15.37:0/4030211386":"2021-01-28T13:30:13.087341+0000","172.21.15.37:0/588400976":"2021-01-28T13:29:50.235508+0000","172.21.15.37:0/3061529231":"2021-01-28T13:29:50.235508+0000","172.21.15.37:6800/2077595097":"2021-01-28T13:29:50.235508+0000","172.21.15.37:0/2633512979":"2021-01-28T13:30:13.087341+0000","172.21.15.37:6801/2077595097":"2021-01-28T13:29:50.235508+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T13:37:29.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:29 smithi099 bash[9889]: cluster 2021-01-27T13:37:28.181813+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:29.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:29 smithi037 bash[9724]: cluster 2021-01-27T13:37:28.181813+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:29.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:29 smithi037 bash[13442]: cluster 2021-01-27T13:37:28.181813+0000 mgr.y (mgr.14138) 389 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:30.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-01-27T13:37:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:30.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:30 smithi099 bash[9889]: audit 2021-01-27T13:37:29.773961+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.37:0/3112793882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:37:30.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:30 smithi037 bash[9724]: audit 2021-01-27T13:37:29.773961+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.37:0/3112793882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:37:30.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:30 smithi037 bash[13442]: audit 2021-01-27T13:37:29.773961+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.37:0/3112793882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:37:31.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:31 smithi099 bash[9889]: cluster 2021-01-27T13:37:30.183019+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:31.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:31 smithi037 bash[9724]: cluster 2021-01-27T13:37:30.183019+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:31.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:31 smithi037 bash[13442]: cluster 2021-01-27T13:37:30.183019+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:33.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:33 smithi099 bash[9889]: cluster 2021-01-27T13:37:32.184196+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:33.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:33 smithi037 bash[9724]: cluster 2021-01-27T13:37:32.184196+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:33.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:33 smithi037 bash[13442]: cluster 2021-01-27T13:37:32.184196+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:34.600 INFO:teuthology.orchestra.run.smithi037.stdout:42949673024 2021-01-27T13:37:34.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-01-27T13:37:34.752 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:35.778 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:35 smithi037 bash[9724]: cluster 2021-01-27T13:37:34.185397+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:35.779 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:35 smithi037 bash[13442]: cluster 2021-01-27T13:37:34.185397+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:35.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:35 smithi099 bash[9889]: cluster 2021-01-27T13:37:34.185397+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:37.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:37 smithi099 bash[9889]: cluster 2021-01-27T13:37:36.186712+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:37.811 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:37:37 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:37:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:37 smithi037 bash[9724]: cluster 2021-01-27T13:37:36.186712+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:37.823 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:37:37 smithi037 bash[9955]: debug 2021-01-27T13:37:37.718+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:37:37.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:37 smithi037 bash[13442]: cluster 2021-01-27T13:37:36.186712+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:38.661 INFO:teuthology.orchestra.run.smithi037.stdout:68719476795 2021-01-27T13:37:38.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-01-27T13:37:38.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:38 smithi099 bash[9889]: audit 2021-01-27T13:37:37.722695+0000 mgr.y (mgr.14138) 394 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:38.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:38 smithi037 bash[9724]: audit 2021-01-27T13:37:37.722695+0000 mgr.y (mgr.14138) 394 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:38.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:38 smithi037 bash[13442]: audit 2021-01-27T13:37:37.722695+0000 mgr.y (mgr.14138) 394 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:38.828 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:39.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:39 smithi099 bash[9889]: cluster 2021-01-27T13:37:38.187788+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:39.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:39 smithi037 bash[9724]: cluster 2021-01-27T13:37:38.187788+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:39.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:39 smithi037 bash[13442]: cluster 2021-01-27T13:37:38.187788+0000 mgr.y (mgr.14138) 395 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:41.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:41 smithi099 bash[9889]: cluster 2021-01-27T13:37:40.188971+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:41.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:41 smithi037 bash[13442]: cluster 2021-01-27T13:37:40.188971+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:41.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:41 smithi037 bash[9724]: cluster 2021-01-27T13:37:40.188971+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:90194313269 2021-01-27T13:37:42.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-01-27T13:37:43.076 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:43.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:43 smithi099 bash[9889]: cluster 2021-01-27T13:37:42.190121+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:43.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:43 smithi037 bash[9724]: cluster 2021-01-27T13:37:42.190121+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:43.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:43 smithi037 bash[13442]: cluster 2021-01-27T13:37:42.190121+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:45.810 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:45 smithi099 bash[9889]: cluster 2021-01-27T13:37:44.191004+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:45.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:45 smithi037 bash[9724]: cluster 2021-01-27T13:37:44.191004+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:45.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:45 smithi037 bash[13442]: cluster 2021-01-27T13:37:44.191004+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:47.033 INFO:teuthology.orchestra.run.smithi037.stdout:111669149745 2021-01-27T13:37:47.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-01-27T13:37:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:47.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:47 smithi037 bash[9724]: cluster 2021-01-27T13:37:46.192157+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:47.826 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:47 smithi037 bash[13442]: cluster 2021-01-27T13:37:46.192157+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:47.827 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:37:47 smithi037 bash[9955]: debug 2021-01-27T13:37:47.726+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:37:48.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:47 smithi099 bash[9889]: cluster 2021-01-27T13:37:46.192157+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:48.061 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:37:47 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:37:48.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:48 smithi037 bash[9724]: audit 2021-01-27T13:37:47.732733+0000 mgr.y (mgr.14138) 400 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:48.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:48 smithi037 bash[13442]: audit 2021-01-27T13:37:47.732733+0000 mgr.y (mgr.14138) 400 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:49.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:48 smithi099 bash[9889]: audit 2021-01-27T13:37:47.732733+0000 mgr.y (mgr.14138) 400 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:50.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:49 smithi037 bash[9724]: cluster 2021-01-27T13:37:48.193243+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:50.002 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:49 smithi037 bash[13442]: cluster 2021-01-27T13:37:48.193243+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:50.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:49 smithi099 bash[9889]: cluster 2021-01-27T13:37:48.193243+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:51.040 INFO:teuthology.orchestra.run.smithi037.stdout:133143986221 2021-01-27T13:37:51.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-01-27T13:37:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:52.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:51 smithi099 bash[9889]: cluster 2021-01-27T13:37:50.194427+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T13:37:52.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:51 smithi037 bash[9724]: cluster 2021-01-27T13:37:50.194427+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T13:37:52.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:51 smithi037 bash[13442]: cluster 2021-01-27T13:37:50.194427+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T13:37:54.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:53 smithi099 bash[9889]: cluster 2021-01-27T13:37:52.195240+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:54.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:53 smithi037 bash[9724]: cluster 2021-01-27T13:37:52.195240+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:54.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:53 smithi037 bash[13442]: cluster 2021-01-27T13:37:52.195240+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:55.302 INFO:teuthology.orchestra.run.smithi037.stdout:154618822697 2021-01-27T13:37:55.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-01-27T13:37:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:55.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:55 smithi037 bash[9724]: cluster 2021-01-27T13:37:54.196313+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:55.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:55 smithi037 bash[13442]: cluster 2021-01-27T13:37:54.196313+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:56.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:55 smithi099 bash[9889]: cluster 2021-01-27T13:37:54.196313+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:37:57.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:57 smithi037 bash[9724]: cluster 2021-01-27T13:37:56.197629+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:57.744 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:57 smithi037 bash[13442]: cluster 2021-01-27T13:37:56.197629+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:58.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:57 smithi099 bash[9889]: cluster 2021-01-27T13:37:56.197629+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:58.061 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:37:57 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:37:58.072 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:37:57 smithi037 bash[9955]: debug 2021-01-27T13:37:57.738+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:37:58.809 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:58 smithi037 bash[9724]: audit 2021-01-27T13:37:57.744287+0000 mgr.y (mgr.14138) 406 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:58.810 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:58 smithi037 bash[13442]: audit 2021-01-27T13:37:57.744287+0000 mgr.y (mgr.14138) 406 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:59.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:58 smithi099 bash[9889]: audit 2021-01-27T13:37:57.744287+0000 mgr.y (mgr.14138) 406 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:37:59.526 INFO:teuthology.orchestra.run.smithi037.stdout:176093659171 2021-01-27T13:37:59.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-01-27T13:37:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:37:59.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:37:59 smithi037 bash[9724]: cluster 2021-01-27T13:37:58.198475+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:37:59.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:37:59 smithi037 bash[13442]: cluster 2021-01-27T13:37:58.198475+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:00.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:37:59 smithi099 bash[9889]: cluster 2021-01-27T13:37:58.198475+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:02.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:01 smithi099 bash[9889]: cluster 2021-01-27T13:38:00.199624+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:02.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:01 smithi037 bash[9724]: cluster 2021-01-27T13:38:00.199624+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:02.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:01 smithi037 bash[13442]: cluster 2021-01-27T13:38:00.199624+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:03.674 INFO:teuthology.orchestra.run.smithi037.stdout:206158430239 2021-01-27T13:38:03.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-01-27T13:38:03.829 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:03.882 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:03 smithi037 bash[9724]: cluster 2021-01-27T13:38:02.200765+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:03.883 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:03 smithi037 bash[13442]: cluster 2021-01-27T13:38:02.200765+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:04.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:03 smithi099 bash[9889]: cluster 2021-01-27T13:38:02.200765+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:06.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:05 smithi099 bash[9889]: cluster 2021-01-27T13:38:04.201878+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:06.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:05 smithi037 bash[9724]: cluster 2021-01-27T13:38:04.201878+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:06.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:05 smithi037 bash[13442]: cluster 2021-01-27T13:38:04.201878+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:07.000 INFO:teuthology.orchestra.run.smithi037.stdout:42949673031 2021-01-27T13:38:07.838 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673024 got 42949673031 for osd.0 2021-01-27T13:38:07.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-01-27T13:38:07.996 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:08.053 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:38:07 smithi037 bash[9955]: debug 2021-01-27T13:38:07.750+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:38:08.053 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:07 smithi037 bash[13442]: cluster 2021-01-27T13:38:06.203002+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:08.053 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:07 smithi037 bash[13442]: audit 2021-01-27T13:38:07.000730+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.37:0/1951498881' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T13:38:08.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:07 smithi037 bash[9724]: cluster 2021-01-27T13:38:06.203002+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:08.054 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:07 smithi037 bash[9724]: audit 2021-01-27T13:38:07.000730+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.37:0/1951498881' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T13:38:08.061 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:38:07 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:38:08.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:07 smithi099 bash[9889]: cluster 2021-01-27T13:38:06.203002+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:08.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:07 smithi099 bash[9889]: audit 2021-01-27T13:38:07.000730+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.37:0/1951498881' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T13:38:09.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:08 smithi099 bash[9889]: audit 2021-01-27T13:38:07.755571+0000 mgr.y (mgr.14138) 412 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:09.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:08 smithi037 bash[9724]: audit 2021-01-27T13:38:07.755571+0000 mgr.y (mgr.14138) 412 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:09.066 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:08 smithi037 bash[13442]: audit 2021-01-27T13:38:07.755571+0000 mgr.y (mgr.14138) 412 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:10.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:09 smithi099 bash[9889]: cluster 2021-01-27T13:38:08.203841+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:10.062 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:09 smithi037 bash[9724]: cluster 2021-01-27T13:38:08.203841+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:10.062 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:09 smithi037 bash[13442]: cluster 2021-01-27T13:38:08.203841+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:11.390 INFO:teuthology.orchestra.run.smithi037.stdout:68719476802 2021-01-27T13:38:11.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:11 smithi037 bash[9724]: cluster 2021-01-27T13:38:10.204950+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:11.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:11 smithi037 bash[9724]: audit 2021-01-27T13:38:11.390605+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.37:0/2857945028' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T13:38:11.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:11 smithi037 bash[13442]: cluster 2021-01-27T13:38:10.204950+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:11.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:11 smithi037 bash[13442]: audit 2021-01-27T13:38:11.390605+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.37:0/2857945028' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T13:38:12.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:11 smithi099 bash[9889]: cluster 2021-01-27T13:38:10.204950+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:12.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:11 smithi099 bash[9889]: audit 2021-01-27T13:38:11.390605+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.37:0/2857945028' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T13:38:12.227 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476795 got 68719476802 for osd.1 2021-01-27T13:38:12.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-01-27T13:38:12.382 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:13.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:13 smithi037 bash[9724]: cluster 2021-01-27T13:38:12.206195+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:13.751 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:13 smithi037 bash[13442]: cluster 2021-01-27T13:38:12.206195+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:14.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:13 smithi099 bash[9889]: cluster 2021-01-27T13:38:12.206195+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:14.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:14 smithi037 bash[9724]: audit 2021-01-27T13:38:14.284346+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:38:14.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:14 smithi037 bash[9724]: audit 2021-01-27T13:38:14.284796+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:38:14.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:14 smithi037 bash[13442]: audit 2021-01-27T13:38:14.284346+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:38:14.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:14 smithi037 bash[13442]: audit 2021-01-27T13:38:14.284796+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:38:15.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:14 smithi099 bash[9889]: audit 2021-01-27T13:38:14.284346+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:38:15.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:14 smithi099 bash[9889]: audit 2021-01-27T13:38:14.284796+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:38:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:15 smithi037 bash[9724]: cluster 2021-01-27T13:38:14.207293+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:15.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:15 smithi037 bash[13442]: cluster 2021-01-27T13:38:14.207293+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:15.889 INFO:teuthology.orchestra.run.smithi037.stdout:90194313276 2021-01-27T13:38:16.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:15 smithi099 bash[9889]: cluster 2021-01-27T13:38:14.207293+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:16.659 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313269 got 90194313276 for osd.2 2021-01-27T13:38:16.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-01-27T13:38:16.814 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:16.909 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:16 smithi037 bash[9724]: audit 2021-01-27T13:38:15.890428+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.15.37:0/2527426185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T13:38:16.910 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:16 smithi037 bash[13442]: audit 2021-01-27T13:38:15.890428+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.15.37:0/2527426185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T13:38:17.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:16 smithi099 bash[9889]: audit 2021-01-27T13:38:15.890428+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.15.37:0/2527426185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T13:38:17.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:17 smithi037 bash[9724]: cluster 2021-01-27T13:38:16.208357+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:17.977 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:38:17 smithi037 bash[9955]: debug 2021-01-27T13:38:17.762+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:38:17.978 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:17 smithi037 bash[13442]: cluster 2021-01-27T13:38:16.208357+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:18.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:17 smithi099 bash[9889]: cluster 2021-01-27T13:38:16.208357+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:18.062 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:38:17 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:38:19.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:18 smithi099 bash[9889]: audit 2021-01-27T13:38:17.767052+0000 mgr.y (mgr.14138) 418 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:19.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:18 smithi037 bash[9724]: audit 2021-01-27T13:38:17.767052+0000 mgr.y (mgr.14138) 418 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:19.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:18 smithi037 bash[13442]: audit 2021-01-27T13:38:17.767052+0000 mgr.y (mgr.14138) 418 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:19.967 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:19 smithi037 bash[9724]: cluster 2021-01-27T13:38:18.209132+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:19.967 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:19 smithi037 bash[13442]: cluster 2021-01-27T13:38:18.209132+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:20.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:19 smithi099 bash[9889]: cluster 2021-01-27T13:38:18.209132+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:20.269 INFO:teuthology.orchestra.run.smithi037.stdout:111669149751 2021-01-27T13:38:20.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:20 smithi037 bash[9724]: audit 2021-01-27T13:38:20.269997+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.37:0/1439285516' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T13:38:21.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:20 smithi099 bash[9889]: audit 2021-01-27T13:38:20.269997+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.37:0/1439285516' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T13:38:21.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:20 smithi037 bash[13442]: audit 2021-01-27T13:38:20.269997+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.37:0/1439285516' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T13:38:21.104 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149745 got 111669149751 for osd.3 2021-01-27T13:38:21.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-01-27T13:38:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:22.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:21 smithi099 bash[9889]: cluster 2021-01-27T13:38:20.210239+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:22.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:21 smithi037 bash[9724]: cluster 2021-01-27T13:38:20.210239+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:22.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:21 smithi037 bash[13442]: cluster 2021-01-27T13:38:20.210239+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:24.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:23 smithi099 bash[9889]: cluster 2021-01-27T13:38:22.211380+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:24.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:23 smithi037 bash[9724]: cluster 2021-01-27T13:38:22.211380+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:24.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:23 smithi037 bash[13442]: cluster 2021-01-27T13:38:22.211380+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:24.582 INFO:teuthology.orchestra.run.smithi037.stdout:133143986227 2021-01-27T13:38:25.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:24 smithi099 bash[9889]: audit 2021-01-27T13:38:24.583129+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.37:0/3569520661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T13:38:25.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:24 smithi037 bash[9724]: audit 2021-01-27T13:38:24.583129+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.37:0/3569520661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T13:38:25.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:24 smithi037 bash[13442]: audit 2021-01-27T13:38:24.583129+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.37:0/3569520661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T13:38:25.420 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986221 got 133143986227 for osd.4 2021-01-27T13:38:25.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-01-27T13:38:25.575 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:26.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:25 smithi099 bash[9889]: cluster 2021-01-27T13:38:24.212708+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:26.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:25 smithi037 bash[9724]: cluster 2021-01-27T13:38:24.212708+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:26.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:25 smithi037 bash[13442]: cluster 2021-01-27T13:38:24.212708+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:28.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:27 smithi099 bash[9889]: cluster 2021-01-27T13:38:26.213791+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:28.062 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:38:27 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:38:28.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:27 smithi037 bash[9724]: cluster 2021-01-27T13:38:26.213791+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:28.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:27 smithi037 bash[13442]: cluster 2021-01-27T13:38:26.213791+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:28.074 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:38:27 smithi037 bash[9955]: debug 2021-01-27T13:38:27.774+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:38:29.003 INFO:teuthology.orchestra.run.smithi037.stdout:154618822704 2021-01-27T13:38:29.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:28 smithi099 bash[9889]: audit 2021-01-27T13:38:27.778497+0000 mgr.y (mgr.14138) 424 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:29.062 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:28 smithi037 bash[9724]: audit 2021-01-27T13:38:27.778497+0000 mgr.y (mgr.14138) 424 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:29.062 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:28 smithi037 bash[13442]: audit 2021-01-27T13:38:27.778497+0000 mgr.y (mgr.14138) 424 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:29.892 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822697 got 154618822704 for osd.5 2021-01-27T13:38:29.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-01-27T13:38:30.047 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:30.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:29 smithi099 bash[9889]: cluster 2021-01-27T13:38:28.214753+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:30.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:29 smithi099 bash[9889]: audit 2021-01-27T13:38:29.003519+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.37:0/3677424320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T13:38:30.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:29 smithi037 bash[9724]: cluster 2021-01-27T13:38:28.214753+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:30.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:29 smithi037 bash[9724]: audit 2021-01-27T13:38:29.003519+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.37:0/3677424320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T13:38:30.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:29 smithi037 bash[13442]: cluster 2021-01-27T13:38:28.214753+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:30.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:29 smithi037 bash[13442]: audit 2021-01-27T13:38:29.003519+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.37:0/3677424320' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T13:38:32.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:31 smithi037 bash[9724]: cluster 2021-01-27T13:38:30.215843+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:32.017 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:31 smithi037 bash[13442]: cluster 2021-01-27T13:38:30.215843+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:32.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:31 smithi099 bash[9889]: cluster 2021-01-27T13:38:30.215843+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:33.416 INFO:teuthology.orchestra.run.smithi037.stdout:176093659178 2021-01-27T13:38:34.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:33 smithi099 bash[9889]: cluster 2021-01-27T13:38:32.217036+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:34.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:33 smithi099 bash[9889]: audit 2021-01-27T13:38:33.417171+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.37:0/790463361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T13:38:34.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:33 smithi037 bash[9724]: cluster 2021-01-27T13:38:32.217036+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:34.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:33 smithi037 bash[9724]: audit 2021-01-27T13:38:33.417171+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.37:0/790463361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T13:38:34.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:33 smithi037 bash[13442]: cluster 2021-01-27T13:38:32.217036+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:34.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:33 smithi037 bash[13442]: audit 2021-01-27T13:38:33.417171+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.37:0/790463361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T13:38:34.189 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659171 got 176093659178 for osd.6 2021-01-27T13:38:34.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-01-27T13:38:34.347 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:36.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:35 smithi099 bash[9889]: cluster 2021-01-27T13:38:34.218212+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:36.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:35 smithi037 bash[9724]: cluster 2021-01-27T13:38:34.218212+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:36.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:35 smithi037 bash[13442]: cluster 2021-01-27T13:38:34.218212+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:37.712 INFO:teuthology.orchestra.run.smithi037.stdout:206158430246 2021-01-27T13:38:38.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:37 smithi099 bash[9889]: cluster 2021-01-27T13:38:36.219296+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:38.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:37 smithi099 bash[9889]: audit 2021-01-27T13:38:37.712491+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.37:0/4225806291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T13:38:38.062 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:38:37 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:38:38.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:37 smithi037 bash[9724]: cluster 2021-01-27T13:38:36.219296+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:38.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:37 smithi037 bash[9724]: audit 2021-01-27T13:38:37.712491+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.37:0/4225806291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T13:38:38.073 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:38:37 smithi037 bash[9955]: debug 2021-01-27T13:38:37.785+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:38:38.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:37 smithi037 bash[13442]: cluster 2021-01-27T13:38:36.219296+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:38.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:37 smithi037 bash[13442]: audit 2021-01-27T13:38:37.712491+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.37:0/4225806291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T13:38:38.570 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430239 got 206158430246 for osd.7 2021-01-27T13:38:38.571 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-01-27T13:38:38.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph pg dump --format=json 2021-01-27T13:38:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:38.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:38 smithi037 bash[9724]: audit 2021-01-27T13:38:37.789974+0000 mgr.y (mgr.14138) 430 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:38.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:38 smithi037 bash[13442]: audit 2021-01-27T13:38:37.789974+0000 mgr.y (mgr.14138) 430 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:39.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:38 smithi099 bash[9889]: audit 2021-01-27T13:38:37.789974+0000 mgr.y (mgr.14138) 430 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:40.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:39 smithi037 bash[9724]: cluster 2021-01-27T13:38:38.220278+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:40.005 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:39 smithi037 bash[13442]: cluster 2021-01-27T13:38:38.220278+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:40.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:39 smithi099 bash[9889]: cluster 2021-01-27T13:38:38.220278+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: 2021-01-27T13:38:42.066 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2021-01-27T13:38:42.067 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:41 smithi099 bash[9889]: cluster 2021-01-27T13:38:40.221361+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:42.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:41 smithi037 bash[13442]: cluster 2021-01-27T13:38:40.221361+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:42.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:41 smithi037 bash[9724]: cluster 2021-01-27T13:38:40.221361+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:42.926 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2021-01-27T13:38:40.220634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":1252,"num_read_kb":752,"num_write":567,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":3138,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":51452,"kb_used_data":6972,"kb_used_omap":0,"kb_used_meta":44416,"kb_avail":749909764,"statfs":{"total":767960285184,"available":767907598336,"internally_reserved":0,"allocated":7139328,"data_stored":2357214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45481984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006532"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.914665+0000","last_change":"2021-01-27T13:35:59.862068+0000","last_active":"2021-01-27T13:36:14.914665+0000","last_peered":"2021-01-27T13:36:14.914665+0000","last_clean":"2021-01-27T13:36:14.914665+0000","last_became_active":"2021-01-27T13:35:59.861426+0000","last_became_peered":"2021-01-27T13:35:59.861426+0000","last_unstale":"2021-01-27T13:36:14.914665+0000","last_undegraded":"2021-01-27T13:36:14.914665+0000","last_fullsized":"2021-01-27T13:36:14.914665+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.919731+0000","last_change":"2021-01-27T13:35:56.826752+0000","last_active":"2021-01-27T13:36:14.919731+0000","last_peered":"2021-01-27T13:36:14.919731+0000","last_clean":"2021-01-27T13:36:14.919731+0000","last_became_active":"2021-01-27T13:35:56.826361+0000","last_became_peered":"2021-01-27T13:35:56.826361+0000","last_unstale":"2021-01-27T13:36:14.919731+0000","last_undegraded":"2021-01-27T13:36:14.919731+0000","last_fullsized":"2021-01-27T13:36:14.919731+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"49'3","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923058+0000","last_change":"2021-01-27T13:35:39.191186+0000","last_active":"2021-01-27T13:36:14.923058+0000","last_peered":"2021-01-27T13:36:14.923058+0000","last_clean":"2021-01-27T13:36:14.923058+0000","last_became_active":"2021-01-27T13:35:39.190631+0000","last_became_peered":"2021-01-27T13:35:39.190631+0000","last_unstale":"2021-01-27T13:36:14.923058+0000","last_undegraded":"2021-01-27T13:36:14.923058+0000","last_fullsized":"2021-01-27T13:36:14.923058+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'20","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916922+0000","last_change":"2021-01-27T13:35:54.800395+0000","last_active":"2021-01-27T13:36:14.916922+0000","last_peered":"2021-01-27T13:36:14.916922+0000","last_clean":"2021-01-27T13:36:14.916922+0000","last_became_active":"2021-01-27T13:35:54.799975+0000","last_became_peered":"2021-01-27T13:35:54.799975+0000","last_unstale":"2021-01-27T13:36:14.916922+0000","last_undegraded":"2021-01-27T13:36:14.916922+0000","last_fullsized":"2021-01-27T13:36:14.916922+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":22,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920045+0000","last_change":"2021-01-27T13:35:59.859002+0000","last_active":"2021-01-27T13:36:14.920045+0000","last_peered":"2021-01-27T13:36:14.920045+0000","last_clean":"2021-01-27T13:36:14.920045+0000","last_became_active":"2021-01-27T13:35:59.858378+0000","last_became_peered":"2021-01-27T13:35:59.858378+0000","last_unstale":"2021-01-27T13:36:14.920045+0000","last_undegraded":"2021-01-27T13:36:14.920045+0000","last_fullsized":"2021-01-27T13:36:14.920045+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918342+0000","last_change":"2021-01-27T13:35:56.826700+0000","last_active":"2021-01-27T13:36:14.918342+0000","last_peered":"2021-01-27T13:36:14.918342+0000","last_clean":"2021-01-27T13:36:14.918342+0000","last_became_active":"2021-01-27T13:35:56.826248+0000","last_became_peered":"2021-01-27T13:35:56.826248+0000","last_unstale":"2021-01-27T13:36:14.918342+0000","last_undegraded":"2021-01-27T13:36:14.918342+0000","last_fullsized":"2021-01-27T13:36:14.918342+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917801+0000","last_change":"2021-01-27T13:35:35.150503+0000","last_active":"2021-01-27T13:36:14.917801+0000","last_peered":"2021-01-27T13:36:14.917801+0000","last_clean":"2021-01-27T13:36:14.917801+0000","last_became_active":"2021-01-27T13:35:35.150050+0000","last_became_peered":"2021-01-27T13:35:35.150050+0000","last_unstale":"2021-01-27T13:36:14.917801+0000","last_undegraded":"2021-01-27T13:36:14.917801+0000","last_fullsized":"2021-01-27T13:36:14.917801+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"60'15","reported_seq":"77","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:36:16.390280+0000","last_change":"2021-01-27T13:36:16.390280+0000","last_active":"2021-01-27T13:36:16.390280+0000","last_peered":"2021-01-27T13:36:16.390280+0000","last_clean":"2021-01-27T13:36:16.390280+0000","last_became_active":"2021-01-27T13:36:15.932365+0000","last_became_peered":"2021-01-27T13:36:15.932365+0000","last_unstale":"2021-01-27T13:36:16.390280+0000","last_undegraded":"2021-01-27T13:36:16.390280+0000","last_fullsized":"2021-01-27T13:36:16.390280+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923651+0000","last_change":"2021-01-27T13:35:59.867967+0000","last_active":"2021-01-27T13:36:14.923651+0000","last_peered":"2021-01-27T13:36:14.923651+0000","last_clean":"2021-01-27T13:36:14.923651+0000","last_became_active":"2021-01-27T13:35:59.867548+0000","last_became_peered":"2021-01-27T13:35:59.867548+0000","last_unstale":"2021-01-27T13:36:14.923651+0000","last_undegraded":"2021-01-27T13:36:14.923651+0000","last_fullsized":"2021-01-27T13:36:14.923651+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929362+0000","last_change":"2021-01-27T13:35:56.831867+0000","last_active":"2021-01-27T13:36:14.929362+0000","last_peered":"2021-01-27T13:36:14.929362+0000","last_clean":"2021-01-27T13:36:14.929362+0000","last_became_active":"2021-01-27T13:35:56.831484+0000","last_became_peered":"2021-01-27T13:35:56.831484+0000","last_unstale":"2021-01-27T13:36:14.929362+0000","last_undegraded":"2021-01-27T13:36:14.929362+0000","last_fullsized":"2021-01-27T13:36:14.929362+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929867+0000","last_change":"2021-01-27T13:35:39.196666+0000","last_active":"2021-01-27T13:36:14.929867+0000","last_peered":"2021-01-27T13:36:14.929867+0000","last_clean":"2021-01-27T13:36:14.929867+0000","last_became_active":"2021-01-27T13:35:39.196201+0000","last_became_peered":"2021-01-27T13:35:39.196201+0000","last_unstale":"2021-01-27T13:36:14.929867+0000","last_undegraded":"2021-01-27T13:36:14.929867+0000","last_fullsized":"2021-01-27T13:36:14.929867+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"60'6","reported_seq":"30","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921217+0000","last_change":"2021-01-27T13:35:54.803812+0000","last_active":"2021-01-27T13:36:14.921217+0000","last_peered":"2021-01-27T13:36:14.921217+0000","last_clean":"2021-01-27T13:36:14.921217+0000","last_became_active":"2021-01-27T13:35:54.803352+0000","last_became_peered":"2021-01-27T13:35:54.803352+0000","last_unstale":"2021-01-27T13:36:14.921217+0000","last_undegraded":"2021-01-27T13:36:14.921217+0000","last_fullsized":"2021-01-27T13:36:14.921217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923126+0000","last_change":"2021-01-27T13:35:59.852350+0000","last_active":"2021-01-27T13:36:14.923126+0000","last_peered":"2021-01-27T13:36:14.923126+0000","last_clean":"2021-01-27T13:36:14.923126+0000","last_became_active":"2021-01-27T13:35:59.851865+0000","last_became_peered":"2021-01-27T13:35:59.851865+0000","last_unstale":"2021-01-27T13:36:14.923126+0000","last_undegraded":"2021-01-27T13:36:14.923126+0000","last_fullsized":"2021-01-27T13:36:14.923126+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924439+0000","last_change":"2021-01-27T13:35:56.821343+0000","last_active":"2021-01-27T13:36:14.924439+0000","last_peered":"2021-01-27T13:36:14.924439+0000","last_clean":"2021-01-27T13:36:14.924439+0000","last_became_active":"2021-01-27T13:35:56.820944+0000","last_became_peered":"2021-01-27T13:35:56.820944+0000","last_unstale":"2021-01-27T13:36:14.924439+0000","last_undegraded":"2021-01-27T13:36:14.924439+0000","last_fullsized":"2021-01-27T13:36:14.924439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929745+0000","last_change":"2021-01-27T13:35:39.198223+0000","last_active":"2021-01-27T13:36:14.929745+0000","last_peered":"2021-01-27T13:36:14.929745+0000","last_clean":"2021-01-27T13:36:14.929745+0000","last_became_active":"2021-01-27T13:35:39.197282+0000","last_became_peered":"2021-01-27T13:35:39.197282+0000","last_unstale":"2021-01-27T13:36:14.929745+0000","last_undegraded":"2021-01-27T13:36:14.929745+0000","last_fullsized":"2021-01-27T13:36:14.929745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"60'13","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920142+0000","last_change":"2021-01-27T13:35:54.798979+0000","last_active":"2021-01-27T13:36:14.920142+0000","last_peered":"2021-01-27T13:36:14.920142+0000","last_clean":"2021-01-27T13:36:14.920142+0000","last_became_active":"2021-01-27T13:35:54.798573+0000","last_became_peered":"2021-01-27T13:35:54.798573+0000","last_unstale":"2021-01-27T13:36:14.920142+0000","last_undegraded":"2021-01-27T13:36:14.920142+0000","last_fullsized":"2021-01-27T13:36:14.920142+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917749+0000","last_change":"2021-01-27T13:35:59.864933+0000","last_active":"2021-01-27T13:36:14.917749+0000","last_peered":"2021-01-27T13:36:14.917749+0000","last_clean":"2021-01-27T13:36:14.917749+0000","last_became_active":"2021-01-27T13:35:59.864530+0000","last_became_peered":"2021-01-27T13:35:59.864530+0000","last_unstale":"2021-01-27T13:36:14.917749+0000","last_undegraded":"2021-01-27T13:36:14.917749+0000","last_fullsized":"2021-01-27T13:36:14.917749+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922115+0000","last_change":"2021-01-27T13:35:56.826924+0000","last_active":"2021-01-27T13:36:14.922115+0000","last_peered":"2021-01-27T13:36:14.922115+0000","last_clean":"2021-01-27T13:36:14.922115+0000","last_became_active":"2021-01-27T13:35:56.826461+0000","last_became_peered":"2021-01-27T13:35:56.826461+0000","last_unstale":"2021-01-27T13:36:14.922115+0000","last_undegraded":"2021-01-27T13:36:14.922115+0000","last_fullsized":"2021-01-27T13:36:14.922115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.914852+0000","last_change":"2021-01-27T13:35:39.190382+0000","last_active":"2021-01-27T13:36:14.914852+0000","last_peered":"2021-01-27T13:36:14.914852+0000","last_clean":"2021-01-27T13:36:14.914852+0000","last_became_active":"2021-01-27T13:35:39.189764+0000","last_became_peered":"2021-01-27T13:35:39.189764+0000","last_unstale":"2021-01-27T13:36:14.914852+0000","last_undegraded":"2021-01-27T13:36:14.914852+0000","last_fullsized":"2021-01-27T13:36:14.914852+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"60'16","reported_seq":"49","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917323+0000","last_change":"2021-01-27T13:35:54.800778+0000","last_active":"2021-01-27T13:36:14.917323+0000","last_peered":"2021-01-27T13:36:14.917323+0000","last_clean":"2021-01-27T13:36:14.917323+0000","last_became_active":"2021-01-27T13:35:54.800218+0000","last_became_peered":"2021-01-27T13:35:54.800218+0000","last_unstale":"2021-01-27T13:36:14.917323+0000","last_undegraded":"2021-01-27T13:36:14.917323+0000","last_fullsized":"2021-01-27T13:36:14.917323+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":20,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923759+0000","last_change":"2021-01-27T13:35:59.857197+0000","last_active":"2021-01-27T13:36:14.923759+0000","last_peered":"2021-01-27T13:36:14.923759+0000","last_clean":"2021-01-27T13:36:14.923759+0000","last_became_active":"2021-01-27T13:35:59.856836+0000","last_became_peered":"2021-01-27T13:35:59.856836+0000","last_unstale":"2021-01-27T13:36:14.923759+0000","last_undegraded":"2021-01-27T13:36:14.923759+0000","last_fullsized":"2021-01-27T13:36:14.923759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923603+0000","last_change":"2021-01-27T13:35:56.828171+0000","last_active":"2021-01-27T13:36:14.923603+0000","last_peered":"2021-01-27T13:36:14.923603+0000","last_clean":"2021-01-27T13:36:14.923603+0000","last_became_active":"2021-01-27T13:35:56.827772+0000","last_became_peered":"2021-01-27T13:35:56.827772+0000","last_unstale":"2021-01-27T13:36:14.923603+0000","last_undegraded":"2021-01-27T13:36:14.923603+0000","last_fullsized":"2021-01-27T13:36:14.923603+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"45'1","reported_seq":"41","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924941+0000","last_change":"2021-01-27T13:35:39.208088+0000","last_active":"2021-01-27T13:36:14.924941+0000","last_peered":"2021-01-27T13:36:14.924941+0000","last_clean":"2021-01-27T13:36:14.924941+0000","last_became_active":"2021-01-27T13:35:39.189089+0000","last_became_peered":"2021-01-27T13:35:39.189089+0000","last_unstale":"2021-01-27T13:36:14.924941+0000","last_undegraded":"2021-01-27T13:36:14.924941+0000","last_fullsized":"2021-01-27T13:36:14.924941+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":"43","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921145+0000","last_change":"2021-01-27T13:35:54.801633+0000","last_active":"2021-01-27T13:36:14.921145+0000","last_peered":"2021-01-27T13:36:14.921145+0000","last_clean":"2021-01-27T13:36:14.921145+0000","last_became_active":"2021-01-27T13:35:54.801200+0000","last_became_peered":"2021-01-27T13:35:54.801200+0000","last_unstale":"2021-01-27T13:36:14.921145+0000","last_undegraded":"2021-01-27T13:36:14.921145+0000","last_fullsized":"2021-01-27T13:36:14.921145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923144+0000","last_change":"2021-01-27T13:35:59.864062+0000","last_active":"2021-01-27T13:36:14.923144+0000","last_peered":"2021-01-27T13:36:14.923144+0000","last_clean":"2021-01-27T13:36:14.923144+0000","last_became_active":"2021-01-27T13:35:59.863311+0000","last_became_peered":"2021-01-27T13:35:59.863311+0000","last_unstale":"2021-01-27T13:36:14.923144+0000","last_undegraded":"2021-01-27T13:36:14.923144+0000","last_fullsized":"2021-01-27T13:36:14.923144+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923513+0000","last_change":"2021-01-27T13:35:56.819871+0000","last_active":"2021-01-27T13:36:14.923513+0000","last_peered":"2021-01-27T13:36:14.923513+0000","last_clean":"2021-01-27T13:36:14.923513+0000","last_became_active":"2021-01-27T13:35:56.819326+0000","last_became_peered":"2021-01-27T13:35:56.819326+0000","last_unstale":"2021-01-27T13:36:14.923513+0000","last_undegraded":"2021-01-27T13:36:14.923513+0000","last_fullsized":"2021-01-27T13:36:14.923513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"49'1","reported_seq":"28","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916550+0000","last_change":"2021-01-27T13:35:35.151767+0000","last_active":"2021-01-27T13:36:14.916550+0000","last_peered":"2021-01-27T13:36:14.916550+0000","last_clean":"2021-01-27T13:36:14.916550+0000","last_became_active":"2021-01-27T13:35:35.151283+0000","last_became_peered":"2021-01-27T13:35:35.151283+0000","last_unstale":"2021-01-27T13:36:14.916550+0000","last_undegraded":"2021-01-27T13:36:14.916550+0000","last_fullsized":"2021-01-27T13:36:14.916550+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'17","reported_seq":"49","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.926030+0000","last_change":"2021-01-27T13:35:54.805392+0000","last_active":"2021-01-27T13:36:14.926030+0000","last_peered":"2021-01-27T13:36:14.926030+0000","last_clean":"2021-01-27T13:36:14.926030+0000","last_became_active":"2021-01-27T13:35:54.804981+0000","last_became_peered":"2021-01-27T13:35:54.804981+0000","last_unstale":"2021-01-27T13:36:14.926030+0000","last_undegraded":"2021-01-27T13:36:14.926030+0000","last_fullsized":"2021-01-27T13:36:14.926030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":19,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.930222+0000","last_change":"2021-01-27T13:35:59.849632+0000","last_active":"2021-01-27T13:36:14.930222+0000","last_peered":"2021-01-27T13:36:14.930222+0000","last_clean":"2021-01-27T13:36:14.930222+0000","last_became_active":"2021-01-27T13:35:59.849080+0000","last_became_peered":"2021-01-27T13:35:59.849080+0000","last_unstale":"2021-01-27T13:36:14.930222+0000","last_undegraded":"2021-01-27T13:36:14.930222+0000","last_fullsized":"2021-01-27T13:36:14.930222+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"55'2","reported_seq":"50","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:27.939389+0000","last_change":"2021-01-27T13:35:56.830110+0000","last_active":"2021-01-27T13:38:27.939389+0000","last_peered":"2021-01-27T13:38:27.939389+0000","last_clean":"2021-01-27T13:38:27.939389+0000","last_became_active":"2021-01-27T13:35:56.829741+0000","last_became_peered":"2021-01-27T13:35:56.829741+0000","last_unstale":"2021-01-27T13:38:27.939389+0000","last_undegraded":"2021-01-27T13:38:27.939389+0000","last_fullsized":"2021-01-27T13:38:27.939389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923430+0000","last_change":"2021-01-27T13:35:39.197219+0000","last_active":"2021-01-27T13:36:14.923430+0000","last_peered":"2021-01-27T13:36:14.923430+0000","last_clean":"2021-01-27T13:36:14.923430+0000","last_became_active":"2021-01-27T13:35:39.196715+0000","last_became_peered":"2021-01-27T13:35:39.196715+0000","last_unstale":"2021-01-27T13:36:14.923430+0000","last_undegraded":"2021-01-27T13:36:14.923430+0000","last_fullsized":"2021-01-27T13:36:14.923430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"60'16","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923394+0000","last_change":"2021-01-27T13:35:54.864619+0000","last_active":"2021-01-27T13:36:14.923394+0000","last_peered":"2021-01-27T13:36:14.923394+0000","last_clean":"2021-01-27T13:36:14.923394+0000","last_became_active":"2021-01-27T13:35:54.863091+0000","last_became_peered":"2021-01-27T13:35:54.863091+0000","last_unstale":"2021-01-27T13:36:14.923394+0000","last_undegraded":"2021-01-27T13:36:14.923394+0000","last_fullsized":"2021-01-27T13:36:14.923394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915484+0000","last_change":"2021-01-27T13:35:59.861814+0000","last_active":"2021-01-27T13:36:14.915484+0000","last_peered":"2021-01-27T13:36:14.915484+0000","last_clean":"2021-01-27T13:36:14.915484+0000","last_became_active":"2021-01-27T13:35:59.860848+0000","last_became_peered":"2021-01-27T13:35:59.860848+0000","last_unstale":"2021-01-27T13:36:14.915484+0000","last_undegraded":"2021-01-27T13:36:14.915484+0000","last_fullsized":"2021-01-27T13:36:14.915484+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929104+0000","last_change":"2021-01-27T13:35:56.833167+0000","last_active":"2021-01-27T13:36:14.929104+0000","last_peered":"2021-01-27T13:36:14.929104+0000","last_clean":"2021-01-27T13:36:14.929104+0000","last_became_active":"2021-01-27T13:35:56.832807+0000","last_became_peered":"2021-01-27T13:35:56.832807+0000","last_unstale":"2021-01-27T13:36:14.929104+0000","last_undegraded":"2021-01-27T13:36:14.929104+0000","last_fullsized":"2021-01-27T13:36:14.929104+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'1","reported_seq":"31","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.926078+0000","last_change":"2021-01-27T13:35:38.193632+0000","last_active":"2021-01-27T13:36:14.926078+0000","last_peered":"2021-01-27T13:36:14.926078+0000","last_clean":"2021-01-27T13:36:14.926078+0000","last_became_active":"2021-01-27T13:35:38.189563+0000","last_became_peered":"2021-01-27T13:35:38.189563+0000","last_unstale":"2021-01-27T13:36:14.926078+0000","last_undegraded":"2021-01-27T13:36:14.926078+0000","last_fullsized":"2021-01-27T13:36:14.926078+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"60'14","reported_seq":"43","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916937+0000","last_change":"2021-01-27T13:35:54.859802+0000","last_active":"2021-01-27T13:36:14.916937+0000","last_peered":"2021-01-27T13:36:14.916937+0000","last_clean":"2021-01-27T13:36:14.916937+0000","last_became_active":"2021-01-27T13:35:54.859101+0000","last_became_peered":"2021-01-27T13:35:54.859101+0000","last_unstale":"2021-01-27T13:36:14.916937+0000","last_undegraded":"2021-01-27T13:36:14.916937+0000","last_fullsized":"2021-01-27T13:36:14.916937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":16,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929046+0000","last_change":"2021-01-27T13:35:59.849304+0000","last_active":"2021-01-27T13:36:14.929046+0000","last_peered":"2021-01-27T13:36:14.929046+0000","last_clean":"2021-01-27T13:36:14.929046+0000","last_became_active":"2021-01-27T13:35:59.848582+0000","last_became_peered":"2021-01-27T13:35:59.848582+0000","last_unstale":"2021-01-27T13:36:14.929046+0000","last_undegraded":"2021-01-27T13:36:14.929046+0000","last_fullsized":"2021-01-27T13:36:14.929046+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924136+0000","last_change":"2021-01-27T13:35:56.830281+0000","last_active":"2021-01-27T13:36:14.924136+0000","last_peered":"2021-01-27T13:36:14.924136+0000","last_clean":"2021-01-27T13:36:14.924136+0000","last_became_active":"2021-01-27T13:35:56.829906+0000","last_became_peered":"2021-01-27T13:35:56.829906+0000","last_unstale":"2021-01-27T13:36:14.924136+0000","last_undegraded":"2021-01-27T13:36:14.924136+0000","last_fullsized":"2021-01-27T13:36:14.924136+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"45'1","reported_seq":"29","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924221+0000","last_change":"2021-01-27T13:35:35.137250+0000","last_active":"2021-01-27T13:36:14.924221+0000","last_peered":"2021-01-27T13:36:14.924221+0000","last_clean":"2021-01-27T13:36:14.924221+0000","last_became_active":"2021-01-27T13:35:35.136787+0000","last_became_peered":"2021-01-27T13:35:35.136787+0000","last_unstale":"2021-01-27T13:36:14.924221+0000","last_undegraded":"2021-01-27T13:36:14.924221+0000","last_fullsized":"2021-01-27T13:36:14.924221+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"60'12","reported_seq":"40","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917035+0000","last_change":"2021-01-27T13:35:54.807718+0000","last_active":"2021-01-27T13:36:14.917035+0000","last_peered":"2021-01-27T13:36:14.917035+0000","last_clean":"2021-01-27T13:36:14.917035+0000","last_became_active":"2021-01-27T13:35:54.807299+0000","last_became_peered":"2021-01-27T13:35:54.807299+0000","last_unstale":"2021-01-27T13:36:14.917035+0000","last_undegraded":"2021-01-27T13:36:14.917035+0000","last_fullsized":"2021-01-27T13:36:14.917035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915345+0000","last_change":"2021-01-27T13:35:59.864928+0000","last_active":"2021-01-27T13:36:14.915345+0000","last_peered":"2021-01-27T13:36:14.915345+0000","last_clean":"2021-01-27T13:36:14.915345+0000","last_became_active":"2021-01-27T13:35:59.864503+0000","last_became_peered":"2021-01-27T13:35:59.864503+0000","last_unstale":"2021-01-27T13:36:14.915345+0000","last_undegraded":"2021-01-27T13:36:14.915345+0000","last_fullsized":"2021-01-27T13:36:14.915345+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918772+0000","last_change":"2021-01-27T13:35:56.825084+0000","last_active":"2021-01-27T13:36:14.918772+0000","last_peered":"2021-01-27T13:36:14.918772+0000","last_clean":"2021-01-27T13:36:14.918772+0000","last_became_active":"2021-01-27T13:35:56.824101+0000","last_became_peered":"2021-01-27T13:35:56.824101+0000","last_unstale":"2021-01-27T13:36:14.918772+0000","last_undegraded":"2021-01-27T13:36:14.918772+0000","last_fullsized":"2021-01-27T13:36:14.918772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923295+0000","last_change":"2021-01-27T13:35:35.157324+0000","last_active":"2021-01-27T13:36:14.923295+0000","last_peered":"2021-01-27T13:36:14.923295+0000","last_clean":"2021-01-27T13:36:14.923295+0000","last_became_active":"2021-01-27T13:35:35.156664+0000","last_became_peered":"2021-01-27T13:35:35.156664+0000","last_unstale":"2021-01-27T13:36:14.923295+0000","last_undegraded":"2021-01-27T13:36:14.923295+0000","last_fullsized":"2021-01-27T13:36:14.923295+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'15","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921375+0000","last_change":"2021-01-27T13:35:54.803385+0000","last_active":"2021-01-27T13:36:14.921375+0000","last_peered":"2021-01-27T13:36:14.921375+0000","last_clean":"2021-01-27T13:36:14.921375+0000","last_became_active":"2021-01-27T13:35:54.802531+0000","last_became_peered":"2021-01-27T13:35:54.802531+0000","last_unstale":"2021-01-27T13:36:14.921375+0000","last_undegraded":"2021-01-27T13:36:14.921375+0000","last_fullsized":"2021-01-27T13:36:14.921375+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922425+0000","last_change":"2021-01-27T13:35:59.853900+0000","last_active":"2021-01-27T13:36:14.922425+0000","last_peered":"2021-01-27T13:36:14.922425+0000","last_clean":"2021-01-27T13:36:14.922425+0000","last_became_active":"2021-01-27T13:35:59.853492+0000","last_became_peered":"2021-01-27T13:35:59.853492+0000","last_unstale":"2021-01-27T13:36:14.922425+0000","last_undegraded":"2021-01-27T13:36:14.922425+0000","last_fullsized":"2021-01-27T13:36:14.922425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915212+0000","last_change":"2021-01-27T13:35:56.827833+0000","last_active":"2021-01-27T13:36:14.915212+0000","last_peered":"2021-01-27T13:36:14.915212+0000","last_clean":"2021-01-27T13:36:14.915212+0000","last_became_active":"2021-01-27T13:35:56.827414+0000","last_became_peered":"2021-01-27T13:35:56.827414+0000","last_unstale":"2021-01-27T13:36:14.915212+0000","last_undegraded":"2021-01-27T13:36:14.915212+0000","last_fullsized":"2021-01-27T13:36:14.915212+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924947+0000","last_change":"2021-01-27T13:35:35.149635+0000","last_active":"2021-01-27T13:36:14.924947+0000","last_peered":"2021-01-27T13:36:14.924947+0000","last_clean":"2021-01-27T13:36:14.924947+0000","last_became_active":"2021-01-27T13:35:35.149164+0000","last_became_peered":"2021-01-27T13:35:35.149164+0000","last_unstale":"2021-01-27T13:36:14.924947+0000","last_undegraded":"2021-01-27T13:36:14.924947+0000","last_fullsized":"2021-01-27T13:36:14.924947+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'15","reported_seq":"46","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918518+0000","last_change":"2021-01-27T13:35:54.804688+0000","last_active":"2021-01-27T13:36:14.918518+0000","last_peered":"2021-01-27T13:36:14.918518+0000","last_clean":"2021-01-27T13:36:14.918518+0000","last_became_active":"2021-01-27T13:35:54.804383+0000","last_became_peered":"2021-01-27T13:35:54.804383+0000","last_unstale":"2021-01-27T13:36:14.918518+0000","last_undegraded":"2021-01-27T13:36:14.918518+0000","last_fullsized":"2021-01-27T13:36:14.918518+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923380+0000","last_change":"2021-01-27T13:35:59.852509+0000","last_active":"2021-01-27T13:36:14.923380+0000","last_peered":"2021-01-27T13:36:14.923380+0000","last_clean":"2021-01-27T13:36:14.923380+0000","last_became_active":"2021-01-27T13:35:59.852043+0000","last_became_peered":"2021-01-27T13:35:59.852043+0000","last_unstale":"2021-01-27T13:36:14.923380+0000","last_undegraded":"2021-01-27T13:36:14.923380+0000","last_fullsized":"2021-01-27T13:36:14.923380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"55'2","reported_seq":"50","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:27.939263+0000","last_change":"2021-01-27T13:35:56.834515+0000","last_active":"2021-01-27T13:38:27.939263+0000","last_peered":"2021-01-27T13:38:27.939263+0000","last_clean":"2021-01-27T13:38:27.939263+0000","last_became_active":"2021-01-27T13:35:56.834079+0000","last_became_peered":"2021-01-27T13:35:56.834079+0000","last_unstale":"2021-01-27T13:38:27.939263+0000","last_undegraded":"2021-01-27T13:38:27.939263+0000","last_fullsized":"2021-01-27T13:38:27.939263+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924201+0000","last_change":"2021-01-27T13:35:35.154772+0000","last_active":"2021-01-27T13:36:14.924201+0000","last_peered":"2021-01-27T13:36:14.924201+0000","last_clean":"2021-01-27T13:36:14.924201+0000","last_became_active":"2021-01-27T13:35:35.154354+0000","last_became_peered":"2021-01-27T13:35:35.154354+0000","last_unstale":"2021-01-27T13:36:14.924201+0000","last_undegraded":"2021-01-27T13:36:14.924201+0000","last_fullsized":"2021-01-27T13:36:14.924201+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'13","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924380+0000","last_change":"2021-01-27T13:35:54.861545+0000","last_active":"2021-01-27T13:36:14.924380+0000","last_peered":"2021-01-27T13:36:14.924380+0000","last_clean":"2021-01-27T13:36:14.924380+0000","last_became_active":"2021-01-27T13:35:54.860909+0000","last_became_peered":"2021-01-27T13:35:54.860909+0000","last_unstale":"2021-01-27T13:36:14.924380+0000","last_undegraded":"2021-01-27T13:36:14.924380+0000","last_fullsized":"2021-01-27T13:36:14.924380+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922942+0000","last_change":"2021-01-27T13:35:59.860887+0000","last_active":"2021-01-27T13:36:14.922942+0000","last_peered":"2021-01-27T13:36:14.922942+0000","last_clean":"2021-01-27T13:36:14.922942+0000","last_became_active":"2021-01-27T13:35:59.860501+0000","last_became_peered":"2021-01-27T13:35:59.860501+0000","last_unstale":"2021-01-27T13:36:14.922942+0000","last_undegraded":"2021-01-27T13:36:14.922942+0000","last_fullsized":"2021-01-27T13:36:14.922942+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"55'2","reported_seq":"50","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:27.939416+0000","last_change":"2021-01-27T13:35:56.823320+0000","last_active":"2021-01-27T13:38:27.939416+0000","last_peered":"2021-01-27T13:38:27.939416+0000","last_clean":"2021-01-27T13:38:27.939416+0000","last_became_active":"2021-01-27T13:35:56.822952+0000","last_became_peered":"2021-01-27T13:35:56.822952+0000","last_unstale":"2021-01-27T13:38:27.939416+0000","last_undegraded":"2021-01-27T13:38:27.939416+0000","last_fullsized":"2021-01-27T13:38:27.939416+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"49'4","reported_seq":"50","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923846+0000","last_change":"2021-01-27T13:35:39.306160+0000","last_active":"2021-01-27T13:36:14.923846+0000","last_peered":"2021-01-27T13:36:14.923846+0000","last_clean":"2021-01-27T13:36:14.923846+0000","last_became_active":"2021-01-27T13:35:39.196900+0000","last_became_peered":"2021-01-27T13:35:39.196900+0000","last_unstale":"2021-01-27T13:36:14.923846+0000","last_undegraded":"2021-01-27T13:36:14.923846+0000","last_fullsized":"2021-01-27T13:36:14.923846+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"60'14","reported_seq":"41","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915892+0000","last_change":"2021-01-27T13:35:54.857095+0000","last_active":"2021-01-27T13:36:14.915892+0000","last_peered":"2021-01-27T13:36:14.915892+0000","last_clean":"2021-01-27T13:36:14.915892+0000","last_became_active":"2021-01-27T13:35:54.856231+0000","last_became_peered":"2021-01-27T13:35:54.856231+0000","last_unstale":"2021-01-27T13:36:14.915892+0000","last_undegraded":"2021-01-27T13:36:14.915892+0000","last_fullsized":"2021-01-27T13:36:14.915892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":14,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929805+0000","last_change":"2021-01-27T13:35:59.855833+0000","last_active":"2021-01-27T13:36:14.929805+0000","last_peered":"2021-01-27T13:36:14.929805+0000","last_clean":"2021-01-27T13:36:14.929805+0000","last_became_active":"2021-01-27T13:35:59.855398+0000","last_became_peered":"2021-01-27T13:35:59.855398+0000","last_unstale":"2021-01-27T13:36:14.929805+0000","last_undegraded":"2021-01-27T13:36:14.929805+0000","last_fullsized":"2021-01-27T13:36:14.929805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924105+0000","last_change":"2021-01-27T13:35:56.822952+0000","last_active":"2021-01-27T13:36:14.924105+0000","last_peered":"2021-01-27T13:36:14.924105+0000","last_clean":"2021-01-27T13:36:14.924105+0000","last_became_active":"2021-01-27T13:35:56.822515+0000","last_became_peered":"2021-01-27T13:35:56.822515+0000","last_unstale":"2021-01-27T13:36:14.924105+0000","last_undegraded":"2021-01-27T13:36:14.924105+0000","last_fullsized":"2021-01-27T13:36:14.924105+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"49'1","reported_seq":"28","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924223+0000","last_change":"2021-01-27T13:35:35.160582+0000","last_active":"2021-01-27T13:36:14.924223+0000","last_peered":"2021-01-27T13:36:14.924223+0000","last_clean":"2021-01-27T13:36:14.924223+0000","last_became_active":"2021-01-27T13:35:35.160213+0000","last_became_peered":"2021-01-27T13:35:35.160213+0000","last_unstale":"2021-01-27T13:36:14.924223+0000","last_undegraded":"2021-01-27T13:36:14.924223+0000","last_fullsized":"2021-01-27T13:36:14.924223+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'7","reported_seq":"29","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917533+0000","last_change":"2021-01-27T13:35:54.857148+0000","last_active":"2021-01-27T13:36:14.917533+0000","last_peered":"2021-01-27T13:36:14.917533+0000","last_clean":"2021-01-27T13:36:14.917533+0000","last_became_active":"2021-01-27T13:35:54.856487+0000","last_became_peered":"2021-01-27T13:35:54.856487+0000","last_unstale":"2021-01-27T13:36:14.917533+0000","last_undegraded":"2021-01-27T13:36:14.917533+0000","last_fullsized":"2021-01-27T13:36:14.917533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920576+0000","last_change":"2021-01-27T13:35:59.852428+0000","last_active":"2021-01-27T13:36:14.920576+0000","last_peered":"2021-01-27T13:36:14.920576+0000","last_clean":"2021-01-27T13:36:14.920576+0000","last_became_active":"2021-01-27T13:35:59.848958+0000","last_became_peered":"2021-01-27T13:35:59.848958+0000","last_unstale":"2021-01-27T13:36:14.920576+0000","last_undegraded":"2021-01-27T13:36:14.920576+0000","last_fullsized":"2021-01-27T13:36:14.920576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917861+0000","last_change":"2021-01-27T13:35:56.831305+0000","last_active":"2021-01-27T13:36:14.917861+0000","last_peered":"2021-01-27T13:36:14.917861+0000","last_clean":"2021-01-27T13:36:14.917861+0000","last_became_active":"2021-01-27T13:35:56.830913+0000","last_became_peered":"2021-01-27T13:35:56.830913+0000","last_unstale":"2021-01-27T13:36:14.917861+0000","last_undegraded":"2021-01-27T13:36:14.917861+0000","last_fullsized":"2021-01-27T13:36:14.917861+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916381+0000","last_change":"2021-01-27T13:35:35.148500+0000","last_active":"2021-01-27T13:36:14.916381+0000","last_peered":"2021-01-27T13:36:14.916381+0000","last_clean":"2021-01-27T13:36:14.916381+0000","last_became_active":"2021-01-27T13:35:35.147987+0000","last_became_peered":"2021-01-27T13:35:35.147987+0000","last_unstale":"2021-01-27T13:36:14.916381+0000","last_undegraded":"2021-01-27T13:36:14.916381+0000","last_fullsized":"2021-01-27T13:36:14.916381+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'16","reported_seq":"48","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923121+0000","last_change":"2021-01-27T13:35:54.863498+0000","last_active":"2021-01-27T13:36:14.923121+0000","last_peered":"2021-01-27T13:36:14.923121+0000","last_clean":"2021-01-27T13:36:14.923121+0000","last_became_active":"2021-01-27T13:35:54.862022+0000","last_became_peered":"2021-01-27T13:35:54.862022+0000","last_unstale":"2021-01-27T13:36:14.923121+0000","last_undegraded":"2021-01-27T13:36:14.923121+0000","last_fullsized":"2021-01-27T13:36:14.923121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":18,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915348+0000","last_change":"2021-01-27T13:35:59.864804+0000","last_active":"2021-01-27T13:36:14.915348+0000","last_peered":"2021-01-27T13:36:14.915348+0000","last_clean":"2021-01-27T13:36:14.915348+0000","last_became_active":"2021-01-27T13:35:59.864371+0000","last_became_peered":"2021-01-27T13:35:59.864371+0000","last_unstale":"2021-01-27T13:36:14.915348+0000","last_undegraded":"2021-01-27T13:36:14.915348+0000","last_fullsized":"2021-01-27T13:36:14.915348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"49'2","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923143+0000","last_change":"2021-01-27T13:35:39.257551+0000","last_active":"2021-01-27T13:36:14.923143+0000","last_peered":"2021-01-27T13:36:14.923143+0000","last_clean":"2021-01-27T13:36:14.923143+0000","last_became_active":"2021-01-27T13:35:39.193102+0000","last_became_peered":"2021-01-27T13:35:39.193102+0000","last_unstale":"2021-01-27T13:36:14.923143+0000","last_undegraded":"2021-01-27T13:36:14.923143+0000","last_fullsized":"2021-01-27T13:36:14.923143+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":247,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"60'15","reported_seq":"74","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:36:16.774047+0000","last_change":"2021-01-27T13:36:16.774047+0000","last_active":"2021-01-27T13:36:16.774047+0000","last_peered":"2021-01-27T13:36:16.774047+0000","last_clean":"2021-01-27T13:36:16.774047+0000","last_became_active":"2021-01-27T13:36:16.030060+0000","last_became_peered":"2021-01-27T13:36:16.030060+0000","last_unstale":"2021-01-27T13:36:16.774047+0000","last_undegraded":"2021-01-27T13:36:16.774047+0000","last_fullsized":"2021-01-27T13:36:16.774047+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":19,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916071+0000","last_change":"2021-01-27T13:35:56.820366+0000","last_active":"2021-01-27T13:36:14.916071+0000","last_peered":"2021-01-27T13:36:14.916071+0000","last_clean":"2021-01-27T13:36:14.916071+0000","last_became_active":"2021-01-27T13:35:56.819472+0000","last_became_peered":"2021-01-27T13:35:56.819472+0000","last_unstale":"2021-01-27T13:36:14.916071+0000","last_undegraded":"2021-01-27T13:36:14.916071+0000","last_fullsized":"2021-01-27T13:36:14.916071+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922419+0000","last_change":"2021-01-27T13:35:59.868626+0000","last_active":"2021-01-27T13:36:14.922419+0000","last_peered":"2021-01-27T13:36:14.922419+0000","last_clean":"2021-01-27T13:36:14.922419+0000","last_became_active":"2021-01-27T13:35:59.868231+0000","last_became_peered":"2021-01-27T13:35:59.868231+0000","last_unstale":"2021-01-27T13:36:14.922419+0000","last_undegraded":"2021-01-27T13:36:14.922419+0000","last_fullsized":"2021-01-27T13:36:14.922419+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923823+0000","last_change":"2021-01-27T13:35:39.190919+0000","last_active":"2021-01-27T13:36:14.923823+0000","last_peered":"2021-01-27T13:36:14.923823+0000","last_clean":"2021-01-27T13:36:14.923823+0000","last_became_active":"2021-01-27T13:35:39.190376+0000","last_became_peered":"2021-01-27T13:35:39.190376+0000","last_unstale":"2021-01-27T13:36:14.923823+0000","last_undegraded":"2021-01-27T13:36:14.923823+0000","last_fullsized":"2021-01-27T13:36:14.923823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'16","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918655+0000","last_change":"2021-01-27T13:35:54.807763+0000","last_active":"2021-01-27T13:36:14.918655+0000","last_peered":"2021-01-27T13:36:14.918655+0000","last_clean":"2021-01-27T13:36:14.918655+0000","last_became_active":"2021-01-27T13:35:54.807014+0000","last_became_peered":"2021-01-27T13:35:54.807014+0000","last_unstale":"2021-01-27T13:36:14.918655+0000","last_undegraded":"2021-01-27T13:36:14.918655+0000","last_fullsized":"2021-01-27T13:36:14.918655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"55'2","reported_seq":"51","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:32.942968+0000","last_change":"2021-01-27T13:35:56.821711+0000","last_active":"2021-01-27T13:38:32.942968+0000","last_peered":"2021-01-27T13:38:32.942968+0000","last_clean":"2021-01-27T13:38:32.942968+0000","last_became_active":"2021-01-27T13:35:56.821273+0000","last_became_peered":"2021-01-27T13:35:56.821273+0000","last_unstale":"2021-01-27T13:38:32.942968+0000","last_undegraded":"2021-01-27T13:38:32.942968+0000","last_fullsized":"2021-01-27T13:38:32.942968+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917936+0000","last_change":"2021-01-27T13:35:59.859720+0000","last_active":"2021-01-27T13:36:14.917936+0000","last_peered":"2021-01-27T13:36:14.917936+0000","last_clean":"2021-01-27T13:36:14.917936+0000","last_became_active":"2021-01-27T13:35:59.857343+0000","last_became_peered":"2021-01-27T13:35:59.857343+0000","last_unstale":"2021-01-27T13:36:14.917936+0000","last_undegraded":"2021-01-27T13:36:14.917936+0000","last_fullsized":"2021-01-27T13:36:14.917936+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924020+0000","last_change":"2021-01-27T13:35:35.144264+0000","last_active":"2021-01-27T13:36:14.924020+0000","last_peered":"2021-01-27T13:36:14.924020+0000","last_clean":"2021-01-27T13:36:14.924020+0000","last_became_active":"2021-01-27T13:35:35.143629+0000","last_became_peered":"2021-01-27T13:35:35.143629+0000","last_unstale":"2021-01-27T13:36:14.924020+0000","last_undegraded":"2021-01-27T13:36:14.924020+0000","last_fullsized":"2021-01-27T13:36:14.924020+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"60'25","reported_seq":"65","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923918+0000","last_change":"2021-01-27T13:35:54.810698+0000","last_active":"2021-01-27T13:36:14.923918+0000","last_peered":"2021-01-27T13:36:14.923918+0000","last_clean":"2021-01-27T13:36:14.923918+0000","last_became_active":"2021-01-27T13:35:54.810009+0000","last_became_peered":"2021-01-27T13:35:54.810009+0000","last_unstale":"2021-01-27T13:36:14.923918+0000","last_undegraded":"2021-01-27T13:36:14.923918+0000","last_fullsized":"2021-01-27T13:36:14.923918+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":54,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923529+0000","last_change":"2021-01-27T13:35:56.827498+0000","last_active":"2021-01-27T13:36:14.923529+0000","last_peered":"2021-01-27T13:36:14.923529+0000","last_clean":"2021-01-27T13:36:14.923529+0000","last_became_active":"2021-01-27T13:35:56.827094+0000","last_became_peered":"2021-01-27T13:35:56.827094+0000","last_unstale":"2021-01-27T13:36:14.923529+0000","last_undegraded":"2021-01-27T13:36:14.923529+0000","last_fullsized":"2021-01-27T13:36:14.923529+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929995+0000","last_change":"2021-01-27T13:35:59.860520+0000","last_active":"2021-01-27T13:36:14.929995+0000","last_peered":"2021-01-27T13:36:14.929995+0000","last_clean":"2021-01-27T13:36:14.929995+0000","last_became_active":"2021-01-27T13:35:59.860094+0000","last_became_peered":"2021-01-27T13:35:59.860094+0000","last_unstale":"2021-01-27T13:36:14.929995+0000","last_undegraded":"2021-01-27T13:36:14.929995+0000","last_fullsized":"2021-01-27T13:36:14.929995+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"60'5","reported_seq":"179","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.018899+0000","last_change":"2021-01-27T13:35:52.829669+0000","last_active":"2021-01-27T13:38:37.018899+0000","last_peered":"2021-01-27T13:38:37.018899+0000","last_clean":"2021-01-27T13:38:37.018899+0000","last_became_active":"2021-01-27T13:35:52.829069+0000","last_became_peered":"2021-01-27T13:35:52.829069+0000","last_unstale":"2021-01-27T13:38:37.018899+0000","last_undegraded":"2021-01-27T13:38:37.018899+0000","last_fullsized":"2021-01-27T13:38:37.018899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_clean_scrub_stamp":"2021-01-27T13:35:51.730430+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":156,"num_read_kb":151,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917213+0000","last_change":"2021-01-27T13:35:35.150496+0000","last_active":"2021-01-27T13:36:14.917213+0000","last_peered":"2021-01-27T13:36:14.917213+0000","last_clean":"2021-01-27T13:36:14.917213+0000","last_became_active":"2021-01-27T13:35:35.149975+0000","last_became_peered":"2021-01-27T13:35:35.149975+0000","last_unstale":"2021-01-27T13:36:14.917213+0000","last_undegraded":"2021-01-27T13:36:14.917213+0000","last_fullsized":"2021-01-27T13:36:14.917213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'15","reported_seq":"49","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921947+0000","last_change":"2021-01-27T13:35:54.803898+0000","last_active":"2021-01-27T13:36:14.921947+0000","last_peered":"2021-01-27T13:36:14.921947+0000","last_clean":"2021-01-27T13:36:14.921947+0000","last_became_active":"2021-01-27T13:35:54.803478+0000","last_became_peered":"2021-01-27T13:35:54.803478+0000","last_unstale":"2021-01-27T13:36:14.921947+0000","last_undegraded":"2021-01-27T13:36:14.921947+0000","last_fullsized":"2021-01-27T13:36:14.921947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922173+0000","last_change":"2021-01-27T13:35:56.816684+0000","last_active":"2021-01-27T13:36:14.922173+0000","last_peered":"2021-01-27T13:36:14.922173+0000","last_clean":"2021-01-27T13:36:14.922173+0000","last_became_active":"2021-01-27T13:35:56.816213+0000","last_became_peered":"2021-01-27T13:35:56.816213+0000","last_unstale":"2021-01-27T13:36:14.922173+0000","last_undegraded":"2021-01-27T13:36:14.922173+0000","last_fullsized":"2021-01-27T13:36:14.922173+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.925216+0000","last_change":"2021-01-27T13:35:59.869293+0000","last_active":"2021-01-27T13:36:14.925216+0000","last_peered":"2021-01-27T13:36:14.925216+0000","last_clean":"2021-01-27T13:36:14.925216+0000","last_became_active":"2021-01-27T13:35:59.868734+0000","last_became_peered":"2021-01-27T13:35:59.868734+0000","last_unstale":"2021-01-27T13:36:14.925216+0000","last_undegraded":"2021-01-27T13:36:14.925216+0000","last_fullsized":"2021-01-27T13:36:14.925216+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"20","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915053+0000","last_change":"2021-01-27T13:35:52.838972+0000","last_active":"2021-01-27T13:36:14.915053+0000","last_peered":"2021-01-27T13:36:14.915053+0000","last_clean":"2021-01-27T13:36:14.915053+0000","last_became_active":"2021-01-27T13:35:52.838094+0000","last_became_peered":"2021-01-27T13:35:52.838094+0000","last_unstale":"2021-01-27T13:36:14.915053+0000","last_undegraded":"2021-01-27T13:36:14.915053+0000","last_fullsized":"2021-01-27T13:36:14.915053+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_clean_scrub_stamp":"2021-01-27T13:35:51.730430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924283+0000","last_change":"2021-01-27T13:35:39.197091+0000","last_active":"2021-01-27T13:36:14.924283+0000","last_peered":"2021-01-27T13:36:14.924283+0000","last_clean":"2021-01-27T13:36:14.924283+0000","last_became_active":"2021-01-27T13:35:39.196542+0000","last_became_peered":"2021-01-27T13:35:39.196542+0000","last_unstale":"2021-01-27T13:36:14.924283+0000","last_undegraded":"2021-01-27T13:36:14.924283+0000","last_fullsized":"2021-01-27T13:36:14.924283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.928967+0000","last_change":"2021-01-27T13:35:39.199903+0000","last_active":"2021-01-27T13:36:14.928967+0000","last_peered":"2021-01-27T13:36:14.928967+0000","last_clean":"2021-01-27T13:36:14.928967+0000","last_became_active":"2021-01-27T13:35:39.199136+0000","last_became_peered":"2021-01-27T13:35:39.199136+0000","last_unstale":"2021-01-27T13:36:14.928967+0000","last_undegraded":"2021-01-27T13:36:14.928967+0000","last_fullsized":"2021-01-27T13:36:14.928967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:31:07.313411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:31:07.313411+0000","last_clean_scrub_stamp":"2021-01-27T13:31:07.313411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"60'15","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.925624+0000","last_change":"2021-01-27T13:35:54.862700+0000","last_active":"2021-01-27T13:36:14.925624+0000","last_peered":"2021-01-27T13:36:14.925624+0000","last_clean":"2021-01-27T13:36:14.925624+0000","last_became_active":"2021-01-27T13:35:54.861352+0000","last_became_peered":"2021-01-27T13:35:54.861352+0000","last_unstale":"2021-01-27T13:36:14.925624+0000","last_undegraded":"2021-01-27T13:36:14.925624+0000","last_fullsized":"2021-01-27T13:36:14.925624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929959+0000","last_change":"2021-01-27T13:35:56.825033+0000","last_active":"2021-01-27T13:36:14.929959+0000","last_peered":"2021-01-27T13:36:14.929959+0000","last_clean":"2021-01-27T13:36:14.929959+0000","last_became_active":"2021-01-27T13:35:56.824112+0000","last_became_peered":"2021-01-27T13:35:56.824112+0000","last_unstale":"2021-01-27T13:36:14.929959+0000","last_undegraded":"2021-01-27T13:36:14.929959+0000","last_fullsized":"2021-01-27T13:36:14.929959+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920671+0000","last_change":"2021-01-27T13:35:59.858858+0000","last_active":"2021-01-27T13:36:14.920671+0000","last_peered":"2021-01-27T13:36:14.920671+0000","last_clean":"2021-01-27T13:36:14.920671+0000","last_became_active":"2021-01-27T13:35:59.858189+0000","last_became_peered":"2021-01-27T13:35:59.858189+0000","last_unstale":"2021-01-27T13:36:14.920671+0000","last_undegraded":"2021-01-27T13:36:14.920671+0000","last_fullsized":"2021-01-27T13:36:14.920671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"20","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923279+0000","last_change":"2021-01-27T13:35:52.844207+0000","last_active":"2021-01-27T13:36:14.923279+0000","last_peered":"2021-01-27T13:36:14.923279+0000","last_clean":"2021-01-27T13:36:14.923279+0000","last_became_active":"2021-01-27T13:35:52.843773+0000","last_became_peered":"2021-01-27T13:35:52.843773+0000","last_unstale":"2021-01-27T13:36:14.923279+0000","last_undegraded":"2021-01-27T13:36:14.923279+0000","last_fullsized":"2021-01-27T13:36:14.923279+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_clean_scrub_stamp":"2021-01-27T13:35:51.730430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.928837+0000","last_change":"2021-01-27T13:35:39.193131+0000","last_active":"2021-01-27T13:36:14.928837+0000","last_peered":"2021-01-27T13:36:14.928837+0000","last_clean":"2021-01-27T13:36:14.928837+0000","last_became_active":"2021-01-27T13:35:39.190491+0000","last_became_peered":"2021-01-27T13:35:39.190491+0000","last_unstale":"2021-01-27T13:36:14.928837+0000","last_undegraded":"2021-01-27T13:36:14.928837+0000","last_fullsized":"2021-01-27T13:36:14.928837+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'16","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922859+0000","last_change":"2021-01-27T13:35:54.801114+0000","last_active":"2021-01-27T13:36:14.922859+0000","last_peered":"2021-01-27T13:36:14.922859+0000","last_clean":"2021-01-27T13:36:14.922859+0000","last_became_active":"2021-01-27T13:35:54.800642+0000","last_became_peered":"2021-01-27T13:35:54.800642+0000","last_unstale":"2021-01-27T13:36:14.922859+0000","last_undegraded":"2021-01-27T13:36:14.922859+0000","last_fullsized":"2021-01-27T13:36:14.922859+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.926008+0000","last_change":"2021-01-27T13:35:56.824072+0000","last_active":"2021-01-27T13:36:14.926008+0000","last_peered":"2021-01-27T13:36:14.926008+0000","last_clean":"2021-01-27T13:36:14.926008+0000","last_became_active":"2021-01-27T13:35:56.822624+0000","last_became_peered":"2021-01-27T13:35:56.822624+0000","last_unstale":"2021-01-27T13:36:14.926008+0000","last_undegraded":"2021-01-27T13:36:14.926008+0000","last_fullsized":"2021-01-27T13:36:14.926008+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918238+0000","last_change":"2021-01-27T13:35:59.856886+0000","last_active":"2021-01-27T13:36:14.918238+0000","last_peered":"2021-01-27T13:36:14.918238+0000","last_clean":"2021-01-27T13:36:14.918238+0000","last_became_active":"2021-01-27T13:35:59.856375+0000","last_became_peered":"2021-01-27T13:35:59.856375+0000","last_unstale":"2021-01-27T13:36:14.918238+0000","last_undegraded":"2021-01-27T13:36:14.918238+0000","last_fullsized":"2021-01-27T13:36:14.918238+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929965+0000","last_change":"2021-01-27T13:35:39.192523+0000","last_active":"2021-01-27T13:36:14.929965+0000","last_peered":"2021-01-27T13:36:14.929965+0000","last_clean":"2021-01-27T13:36:14.929965+0000","last_became_active":"2021-01-27T13:35:39.191887+0000","last_became_peered":"2021-01-27T13:35:39.191887+0000","last_unstale":"2021-01-27T13:36:14.929965+0000","last_undegraded":"2021-01-27T13:36:14.929965+0000","last_fullsized":"2021-01-27T13:36:14.929965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"60'21","reported_seq":"58","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924685+0000","last_change":"2021-01-27T13:35:54.856005+0000","last_active":"2021-01-27T13:36:14.924685+0000","last_peered":"2021-01-27T13:36:14.924685+0000","last_clean":"2021-01-27T13:36:14.924685+0000","last_became_active":"2021-01-27T13:35:54.855381+0000","last_became_peered":"2021-01-27T13:35:54.855381+0000","last_unstale":"2021-01-27T13:36:14.924685+0000","last_undegraded":"2021-01-27T13:36:14.924685+0000","last_fullsized":"2021-01-27T13:36:14.924685+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924810+0000","last_change":"2021-01-27T13:35:56.822948+0000","last_active":"2021-01-27T13:36:14.924810+0000","last_peered":"2021-01-27T13:36:14.924810+0000","last_clean":"2021-01-27T13:36:14.924810+0000","last_became_active":"2021-01-27T13:35:56.822551+0000","last_became_peered":"2021-01-27T13:35:56.822551+0000","last_unstale":"2021-01-27T13:36:14.924810+0000","last_undegraded":"2021-01-27T13:36:14.924810+0000","last_fullsized":"2021-01-27T13:36:14.924810+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920473+0000","last_change":"2021-01-27T13:35:59.855018+0000","last_active":"2021-01-27T13:36:14.920473+0000","last_peered":"2021-01-27T13:36:14.920473+0000","last_clean":"2021-01-27T13:36:14.920473+0000","last_became_active":"2021-01-27T13:35:59.854452+0000","last_became_peered":"2021-01-27T13:35:59.854452+0000","last_unstale":"2021-01-27T13:36:14.920473+0000","last_undegraded":"2021-01-27T13:36:14.920473+0000","last_fullsized":"2021-01-27T13:36:14.920473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"45'2","reported_seq":"48","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921558+0000","last_change":"2021-01-27T13:35:38.235900+0000","last_active":"2021-01-27T13:36:14.921558+0000","last_peered":"2021-01-27T13:36:14.921558+0000","last_clean":"2021-01-27T13:36:14.921558+0000","last_became_active":"2021-01-27T13:35:38.184773+0000","last_became_peered":"2021-01-27T13:35:38.184773+0000","last_unstale":"2021-01-27T13:36:14.921558+0000","last_undegraded":"2021-01-27T13:36:14.921558+0000","last_fullsized":"2021-01-27T13:36:14.921558+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'22","reported_seq":"58","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916839+0000","last_change":"2021-01-27T13:35:54.859471+0000","last_active":"2021-01-27T13:36:14.916839+0000","last_peered":"2021-01-27T13:36:14.916839+0000","last_clean":"2021-01-27T13:36:14.916839+0000","last_became_active":"2021-01-27T13:35:54.858612+0000","last_became_peered":"2021-01-27T13:35:54.858612+0000","last_unstale":"2021-01-27T13:36:14.916839+0000","last_undegraded":"2021-01-27T13:36:14.916839+0000","last_fullsized":"2021-01-27T13:36:14.916839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":26,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921124+0000","last_change":"2021-01-27T13:35:56.825234+0000","last_active":"2021-01-27T13:36:14.921124+0000","last_peered":"2021-01-27T13:36:14.921124+0000","last_clean":"2021-01-27T13:36:14.921124+0000","last_became_active":"2021-01-27T13:35:56.824788+0000","last_became_peered":"2021-01-27T13:35:56.824788+0000","last_unstale":"2021-01-27T13:36:14.921124+0000","last_undegraded":"2021-01-27T13:36:14.921124+0000","last_fullsized":"2021-01-27T13:36:14.921124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929934+0000","last_change":"2021-01-27T13:35:59.858877+0000","last_active":"2021-01-27T13:36:14.929934+0000","last_peered":"2021-01-27T13:36:14.929934+0000","last_clean":"2021-01-27T13:36:14.929934+0000","last_became_active":"2021-01-27T13:35:59.858319+0000","last_became_peered":"2021-01-27T13:35:59.858319+0000","last_unstale":"2021-01-27T13:36:14.929934+0000","last_undegraded":"2021-01-27T13:36:14.929934+0000","last_fullsized":"2021-01-27T13:36:14.929934+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.926233+0000","last_change":"2021-01-27T13:35:39.196289+0000","last_active":"2021-01-27T13:36:14.926233+0000","last_peered":"2021-01-27T13:36:14.926233+0000","last_clean":"2021-01-27T13:36:14.926233+0000","last_became_active":"2021-01-27T13:35:39.195825+0000","last_became_peered":"2021-01-27T13:35:39.195825+0000","last_unstale":"2021-01-27T13:36:14.926233+0000","last_undegraded":"2021-01-27T13:36:14.926233+0000","last_fullsized":"2021-01-27T13:36:14.926233+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"60'20","reported_seq":"51","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920170+0000","last_change":"2021-01-27T13:35:54.800827+0000","last_active":"2021-01-27T13:36:14.920170+0000","last_peered":"2021-01-27T13:36:14.920170+0000","last_clean":"2021-01-27T13:36:14.920170+0000","last_became_active":"2021-01-27T13:35:54.800211+0000","last_became_peered":"2021-01-27T13:35:54.800211+0000","last_unstale":"2021-01-27T13:36:14.920170+0000","last_undegraded":"2021-01-27T13:36:14.920170+0000","last_fullsized":"2021-01-27T13:36:14.920170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":39,"num_read_kb":20,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"55'2","reported_seq":"50","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:27.938754+0000","last_change":"2021-01-27T13:35:56.834796+0000","last_active":"2021-01-27T13:38:27.938754+0000","last_peered":"2021-01-27T13:38:27.938754+0000","last_clean":"2021-01-27T13:38:27.938754+0000","last_became_active":"2021-01-27T13:35:56.834328+0000","last_became_peered":"2021-01-27T13:35:56.834328+0000","last_unstale":"2021-01-27T13:38:27.938754+0000","last_undegraded":"2021-01-27T13:38:27.938754+0000","last_fullsized":"2021-01-27T13:38:27.938754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915636+0000","last_change":"2021-01-27T13:35:59.861002+0000","last_active":"2021-01-27T13:36:14.915636+0000","last_peered":"2021-01-27T13:36:14.915636+0000","last_clean":"2021-01-27T13:36:14.915636+0000","last_became_active":"2021-01-27T13:35:59.860600+0000","last_became_peered":"2021-01-27T13:35:59.860600+0000","last_unstale":"2021-01-27T13:36:14.915636+0000","last_undegraded":"2021-01-27T13:36:14.915636+0000","last_fullsized":"2021-01-27T13:36:14.915636+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.925029+0000","last_change":"2021-01-27T13:35:56.836901+0000","last_active":"2021-01-27T13:36:14.925029+0000","last_peered":"2021-01-27T13:36:14.925029+0000","last_clean":"2021-01-27T13:36:14.925029+0000","last_became_active":"2021-01-27T13:35:56.835924+0000","last_became_peered":"2021-01-27T13:35:56.835924+0000","last_unstale":"2021-01-27T13:36:14.925029+0000","last_undegraded":"2021-01-27T13:36:14.925029+0000","last_fullsized":"2021-01-27T13:36:14.925029+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.928953+0000","last_change":"2021-01-27T13:35:39.194125+0000","last_active":"2021-01-27T13:36:14.928953+0000","last_peered":"2021-01-27T13:36:14.928953+0000","last_clean":"2021-01-27T13:36:14.928953+0000","last_became_active":"2021-01-27T13:35:39.193576+0000","last_became_peered":"2021-01-27T13:35:39.193576+0000","last_unstale":"2021-01-27T13:36:14.928953+0000","last_undegraded":"2021-01-27T13:36:14.928953+0000","last_fullsized":"2021-01-27T13:36:14.928953+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"60'15","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.925304+0000","last_change":"2021-01-27T13:35:54.803543+0000","last_active":"2021-01-27T13:36:14.925304+0000","last_peered":"2021-01-27T13:36:14.925304+0000","last_clean":"2021-01-27T13:36:14.925304+0000","last_became_active":"2021-01-27T13:35:54.802882+0000","last_became_peered":"2021-01-27T13:35:54.802882+0000","last_unstale":"2021-01-27T13:36:14.925304+0000","last_undegraded":"2021-01-27T13:36:14.925304+0000","last_fullsized":"2021-01-27T13:36:14.925304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923962+0000","last_change":"2021-01-27T13:35:59.858173+0000","last_active":"2021-01-27T13:36:14.923962+0000","last_peered":"2021-01-27T13:36:14.923962+0000","last_clean":"2021-01-27T13:36:14.923962+0000","last_became_active":"2021-01-27T13:35:59.857791+0000","last_became_peered":"2021-01-27T13:35:59.857791+0000","last_unstale":"2021-01-27T13:36:14.923962+0000","last_undegraded":"2021-01-27T13:36:14.923962+0000","last_fullsized":"2021-01-27T13:36:14.923962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"55'2","reported_seq":"50","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:27.939635+0000","last_change":"2021-01-27T13:35:56.827796+0000","last_active":"2021-01-27T13:38:27.939635+0000","last_peered":"2021-01-27T13:38:27.939635+0000","last_clean":"2021-01-27T13:38:27.939635+0000","last_became_active":"2021-01-27T13:35:56.827528+0000","last_became_peered":"2021-01-27T13:35:56.827528+0000","last_unstale":"2021-01-27T13:38:27.939635+0000","last_undegraded":"2021-01-27T13:38:27.939635+0000","last_fullsized":"2021-01-27T13:38:27.939635+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.919252+0000","last_change":"2021-01-27T13:35:39.184759+0000","last_active":"2021-01-27T13:36:14.919252+0000","last_peered":"2021-01-27T13:36:14.919252+0000","last_clean":"2021-01-27T13:36:14.919252+0000","last_became_active":"2021-01-27T13:35:39.184305+0000","last_became_peered":"2021-01-27T13:35:39.184305+0000","last_unstale":"2021-01-27T13:36:14.919252+0000","last_undegraded":"2021-01-27T13:36:14.919252+0000","last_fullsized":"2021-01-27T13:36:14.919252+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'17","reported_seq":"47","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922125+0000","last_change":"2021-01-27T13:35:54.810866+0000","last_active":"2021-01-27T13:36:14.922125+0000","last_peered":"2021-01-27T13:36:14.922125+0000","last_clean":"2021-01-27T13:36:14.922125+0000","last_became_active":"2021-01-27T13:35:54.810468+0000","last_became_peered":"2021-01-27T13:35:54.810468+0000","last_unstale":"2021-01-27T13:36:14.922125+0000","last_undegraded":"2021-01-27T13:36:14.922125+0000","last_fullsized":"2021-01-27T13:36:14.922125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923018+0000","last_change":"2021-01-27T13:35:59.861413+0000","last_active":"2021-01-27T13:36:14.923018+0000","last_peered":"2021-01-27T13:36:14.923018+0000","last_clean":"2021-01-27T13:36:14.923018+0000","last_became_active":"2021-01-27T13:35:59.861044+0000","last_became_peered":"2021-01-27T13:35:59.861044+0000","last_unstale":"2021-01-27T13:36:14.923018+0000","last_undegraded":"2021-01-27T13:36:14.923018+0000","last_fullsized":"2021-01-27T13:36:14.923018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"55'2","reported_seq":"51","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:32.942971+0000","last_change":"2021-01-27T13:35:56.817833+0000","last_active":"2021-01-27T13:38:32.942971+0000","last_peered":"2021-01-27T13:38:32.942971+0000","last_clean":"2021-01-27T13:38:32.942971+0000","last_became_active":"2021-01-27T13:35:56.816733+0000","last_became_peered":"2021-01-27T13:35:56.816733+0000","last_unstale":"2021-01-27T13:38:32.942971+0000","last_undegraded":"2021-01-27T13:38:32.942971+0000","last_fullsized":"2021-01-27T13:38:32.942971+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918406+0000","last_change":"2021-01-27T13:35:39.190811+0000","last_active":"2021-01-27T13:36:14.918406+0000","last_peered":"2021-01-27T13:36:14.918406+0000","last_clean":"2021-01-27T13:36:14.918406+0000","last_became_active":"2021-01-27T13:35:39.190236+0000","last_became_peered":"2021-01-27T13:35:39.190236+0000","last_unstale":"2021-01-27T13:36:14.918406+0000","last_undegraded":"2021-01-27T13:36:14.918406+0000","last_fullsized":"2021-01-27T13:36:14.918406+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'13","reported_seq":"39","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922021+0000","last_change":"2021-01-27T13:35:54.800684+0000","last_active":"2021-01-27T13:36:14.922021+0000","last_peered":"2021-01-27T13:36:14.922021+0000","last_clean":"2021-01-27T13:36:14.922021+0000","last_became_active":"2021-01-27T13:35:54.800269+0000","last_became_peered":"2021-01-27T13:35:54.800269+0000","last_unstale":"2021-01-27T13:36:14.922021+0000","last_undegraded":"2021-01-27T13:36:14.922021+0000","last_fullsized":"2021-01-27T13:36:14.922021+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922991+0000","last_change":"2021-01-27T13:35:59.867428+0000","last_active":"2021-01-27T13:36:14.922991+0000","last_peered":"2021-01-27T13:36:14.922991+0000","last_clean":"2021-01-27T13:36:14.922991+0000","last_became_active":"2021-01-27T13:35:59.866946+0000","last_became_peered":"2021-01-27T13:35:59.866946+0000","last_unstale":"2021-01-27T13:36:14.922991+0000","last_undegraded":"2021-01-27T13:36:14.922991+0000","last_fullsized":"2021-01-27T13:36:14.922991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920777+0000","last_change":"2021-01-27T13:35:56.829522+0000","last_active":"2021-01-27T13:36:14.920777+0000","last_peered":"2021-01-27T13:36:14.920777+0000","last_clean":"2021-01-27T13:36:14.920777+0000","last_became_active":"2021-01-27T13:35:56.828600+0000","last_became_peered":"2021-01-27T13:35:56.828600+0000","last_unstale":"2021-01-27T13:36:14.920777+0000","last_undegraded":"2021-01-27T13:36:14.920777+0000","last_fullsized":"2021-01-27T13:36:14.920777+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"10","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:36:16.027486+0000","last_change":"2021-01-27T13:36:16.027486+0000","last_active":"2021-01-27T13:36:16.027486+0000","last_peered":"2021-01-27T13:36:16.027486+0000","last_clean":"2021-01-27T13:36:16.027486+0000","last_became_active":"2021-01-27T13:36:16.026813+0000","last_became_peered":"2021-01-27T13:36:16.026813+0000","last_unstale":"2021-01-27T13:36:16.027486+0000","last_undegraded":"2021-01-27T13:36:16.027486+0000","last_fullsized":"2021-01-27T13:36:16.027486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'21","reported_seq":"54","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922668+0000","last_change":"2021-01-27T13:35:54.804557+0000","last_active":"2021-01-27T13:36:14.922668+0000","last_peered":"2021-01-27T13:36:14.922668+0000","last_clean":"2021-01-27T13:36:14.922668+0000","last_became_active":"2021-01-27T13:35:54.803351+0000","last_became_peered":"2021-01-27T13:35:54.803351+0000","last_unstale":"2021-01-27T13:36:14.922668+0000","last_undegraded":"2021-01-27T13:36:14.922668+0000","last_fullsized":"2021-01-27T13:36:14.922668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.928824+0000","last_change":"2021-01-27T13:35:59.869730+0000","last_active":"2021-01-27T13:36:14.928824+0000","last_peered":"2021-01-27T13:36:14.928824+0000","last_clean":"2021-01-27T13:36:14.928824+0000","last_became_active":"2021-01-27T13:35:59.869485+0000","last_became_peered":"2021-01-27T13:35:59.869485+0000","last_unstale":"2021-01-27T13:36:14.928824+0000","last_undegraded":"2021-01-27T13:36:14.928824+0000","last_fullsized":"2021-01-27T13:36:14.928824+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.919963+0000","last_change":"2021-01-27T13:35:56.824095+0000","last_active":"2021-01-27T13:36:14.919963+0000","last_peered":"2021-01-27T13:36:14.919963+0000","last_clean":"2021-01-27T13:36:14.919963+0000","last_became_active":"2021-01-27T13:35:56.823692+0000","last_became_peered":"2021-01-27T13:35:56.823692+0000","last_unstale":"2021-01-27T13:36:14.919963+0000","last_undegraded":"2021-01-27T13:36:14.919963+0000","last_fullsized":"2021-01-27T13:36:14.919963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920900+0000","last_change":"2021-01-27T13:35:35.148020+0000","last_active":"2021-01-27T13:36:14.920900+0000","last_peered":"2021-01-27T13:36:14.920900+0000","last_clean":"2021-01-27T13:36:14.920900+0000","last_became_active":"2021-01-27T13:35:35.147705+0000","last_became_peered":"2021-01-27T13:35:35.147705+0000","last_unstale":"2021-01-27T13:36:14.920900+0000","last_undegraded":"2021-01-27T13:36:14.920900+0000","last_fullsized":"2021-01-27T13:36:14.920900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'23","reported_seq":"57","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924687+0000","last_change":"2021-01-27T13:35:54.859187+0000","last_active":"2021-01-27T13:36:14.924687+0000","last_peered":"2021-01-27T13:36:14.924687+0000","last_clean":"2021-01-27T13:36:14.924687+0000","last_became_active":"2021-01-27T13:35:54.857847+0000","last_became_peered":"2021-01-27T13:35:54.857847+0000","last_unstale":"2021-01-27T13:36:14.924687+0000","last_undegraded":"2021-01-27T13:36:14.924687+0000","last_fullsized":"2021-01-27T13:36:14.924687+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":44,"num_read_kb":25,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922508+0000","last_change":"2021-01-27T13:35:59.855703+0000","last_active":"2021-01-27T13:36:14.922508+0000","last_peered":"2021-01-27T13:36:14.922508+0000","last_clean":"2021-01-27T13:36:14.922508+0000","last_became_active":"2021-01-27T13:35:59.855224+0000","last_became_peered":"2021-01-27T13:35:59.855224+0000","last_unstale":"2021-01-27T13:36:14.922508+0000","last_undegraded":"2021-01-27T13:36:14.922508+0000","last_fullsized":"2021-01-27T13:36:14.922508+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918787+0000","last_change":"2021-01-27T13:35:56.831255+0000","last_active":"2021-01-27T13:36:14.918787+0000","last_peered":"2021-01-27T13:36:14.918787+0000","last_clean":"2021-01-27T13:36:14.918787+0000","last_became_active":"2021-01-27T13:35:56.830590+0000","last_became_peered":"2021-01-27T13:35:56.830590+0000","last_unstale":"2021-01-27T13:36:14.918787+0000","last_undegraded":"2021-01-27T13:36:14.918787+0000","last_fullsized":"2021-01-27T13:36:14.918787+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923460+0000","last_change":"2021-01-27T13:35:35.139639+0000","last_active":"2021-01-27T13:36:14.923460+0000","last_peered":"2021-01-27T13:36:14.923460+0000","last_clean":"2021-01-27T13:36:14.923460+0000","last_became_active":"2021-01-27T13:35:35.139211+0000","last_became_peered":"2021-01-27T13:35:35.139211+0000","last_unstale":"2021-01-27T13:36:14.923460+0000","last_undegraded":"2021-01-27T13:36:14.923460+0000","last_fullsized":"2021-01-27T13:36:14.923460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"60'14","reported_seq":"73","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:36:16.362640+0000","last_change":"2021-01-27T13:36:16.362640+0000","last_active":"2021-01-27T13:36:16.362640+0000","last_peered":"2021-01-27T13:36:16.362640+0000","last_clean":"2021-01-27T13:36:16.362640+0000","last_became_active":"2021-01-27T13:36:15.930756+0000","last_became_peered":"2021-01-27T13:36:15.930756+0000","last_unstale":"2021-01-27T13:36:16.362640+0000","last_undegraded":"2021-01-27T13:36:16.362640+0000","last_fullsized":"2021-01-27T13:36:16.362640+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":16,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":894,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923664+0000","last_change":"2021-01-27T13:35:59.862979+0000","last_active":"2021-01-27T13:36:14.923664+0000","last_peered":"2021-01-27T13:36:14.923664+0000","last_clean":"2021-01-27T13:36:14.923664+0000","last_became_active":"2021-01-27T13:35:59.862546+0000","last_became_peered":"2021-01-27T13:35:59.862546+0000","last_unstale":"2021-01-27T13:36:14.923664+0000","last_undegraded":"2021-01-27T13:36:14.923664+0000","last_fullsized":"2021-01-27T13:36:14.923664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"60'2","reported_seq":"72","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:32.198577+0000","last_change":"2021-01-27T13:35:39.202430+0000","last_active":"2021-01-27T13:38:32.198577+0000","last_peered":"2021-01-27T13:38:32.198577+0000","last_clean":"2021-01-27T13:38:32.198577+0000","last_became_active":"2021-01-27T13:35:39.191559+0000","last_became_peered":"2021-01-27T13:35:39.191559+0000","last_unstale":"2021-01-27T13:38:32.198577+0000","last_undegraded":"2021-01-27T13:38:32.198577+0000","last_fullsized":"2021-01-27T13:38:32.198577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'18","reported_seq":"49","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923550+0000","last_change":"2021-01-27T13:35:54.860007+0000","last_active":"2021-01-27T13:36:14.923550+0000","last_peered":"2021-01-27T13:36:14.923550+0000","last_clean":"2021-01-27T13:36:14.923550+0000","last_became_active":"2021-01-27T13:35:54.858702+0000","last_became_peered":"2021-01-27T13:35:54.858702+0000","last_unstale":"2021-01-27T13:36:14.923550+0000","last_undegraded":"2021-01-27T13:36:14.923550+0000","last_fullsized":"2021-01-27T13:36:14.923550+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":20,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"55'2","reported_seq":"51","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:32.943388+0000","last_change":"2021-01-27T13:35:56.830107+0000","last_active":"2021-01-27T13:38:32.943388+0000","last_peered":"2021-01-27T13:38:32.943388+0000","last_clean":"2021-01-27T13:38:32.943388+0000","last_became_active":"2021-01-27T13:35:56.829697+0000","last_became_peered":"2021-01-27T13:35:56.829697+0000","last_unstale":"2021-01-27T13:38:32.943388+0000","last_undegraded":"2021-01-27T13:38:32.943388+0000","last_fullsized":"2021-01-27T13:38:32.943388+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":1069,"num_read_kb":574,"num_write":542,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":510,"ondisk_log_size":510,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":156,"num_read_kb":151,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":514,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430247,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6228,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738924,"statfs":{"total":95995035648,"available":95988658176,"internally_reserved":0,"allocated":864256,"data_stored":294147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:37:40 2021","interfaces":[{"interface":"back","average":{"1min":2.327,"5min":2.2829999999999999,"15min":2.2749999999999999},"min":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.47},{"interface":"front","average":{"1min":2.1890000000000001,"5min":2.3479999999999999,"15min":2.3740000000000001},"min":{"1min":1.371,"5min":1.371,"15min":1.371},"max":{"1min":4.2329999999999997,"5min":5.3609999999999998,"15min":5.3609999999999998},"last":1.641}]},{"osd":1,"last update":"Wed Jan 27 13:37:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5950000000000002,"5min":2.6150000000000002,"15min":2.6179999999999999},"min":{"1min":1.429,"5min":1.429,"15min":1.429},"max":{"1min":4.0919999999999996,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":3.2589999999999999},{"interface":"front","average":{"1min":2.4359999999999999,"5min":2.6629999999999998,"15min":2.7010000000000001},"min":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"max":{"1min":3.6930000000000001,"5min":3.6930000000000001,"15min":3.6930000000000001},"last":2.7320000000000002}]},{"osd":2,"last update":"Wed Jan 27 13:37:40 2021","interfaces":[{"interface":"back","average":{"1min":2.6859999999999999,"5min":2.77,"15min":2.7839999999999998},"min":{"1min":1.7170000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":4.1980000000000004,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":3.1150000000000002},{"interface":"front","average":{"1min":2.2949999999999999,"5min":2.343,"15min":2.351},"min":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":4.9630000000000001,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":1.548}]},{"osd":3,"last update":"Wed Jan 27 13:37:40 2021","interfaces":[{"interface":"back","average":{"1min":2.512,"5min":2.5,"15min":2.4980000000000002},"min":{"1min":1.52,"5min":1.52,"15min":1.52},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.3959999999999999},{"interface":"front","average":{"1min":2.9500000000000002,"5min":3.1150000000000002,"15min":3.1429999999999998},"min":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"max":{"1min":4.5119999999999996,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":2.891}]},{"osd":4,"last update":"Wed Jan 27 13:37:40 2021","interfaces":[{"interface":"back","average":{"1min":3.0070000000000001,"5min":3.2349999999999999,"15min":3.2730000000000001},"min":{"1min":1.496,"5min":1.496,"15min":1.496},"max":{"1min":4.4260000000000002,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":3.5459999999999998},{"interface":"front","average":{"1min":2.7530000000000001,"5min":2.9209999999999998,"15min":2.9489999999999998},"min":{"1min":1.47,"5min":1.47,"15min":1.47},"max":{"1min":5.3220000000000001,"5min":5.3220000000000001,"15min":5.3220000000000001},"last":2.641}]},{"osd":5,"last update":"Wed Jan 27 13:37:40 2021","interfaces":[{"interface":"back","average":{"1min":3.1419999999999999,"5min":3.3479999999999999,"15min":3.3820000000000001},"min":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"max":{"1min":4.8689999999999998,"5min":6.21,"15min":6.21},"last":3.6459999999999999},{"interface":"front","average":{"1min":3.355,"5min":3.7639999999999998,"15min":3.8319999999999999},"min":{"1min":2.093,"5min":2.093,"15min":2.093},"max":{"1min":4.633,"5min":5.7119999999999997,"15min":5.7119999999999997},"last":4.3369999999999997}]},{"osd":6,"last update":"Wed Jan 27 13:37:40 2021","interfaces":[{"interface":"back","average":{"1min":3.4660000000000002,"5min":3.7890000000000001,"15min":3.843},"min":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"max":{"1min":5.2480000000000002,"5min":6.6029999999999998,"15min":6.6029999999999998},"last":3.8860000000000001},{"interface":"front","average":{"1min":3.633,"5min":3.927,"15min":3.976},"min":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"max":{"1min":4.8360000000000003,"5min":5,"15min":5},"last":3.9409999999999998}]}]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6344,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738808,"statfs":{"total":95995035648,"available":95988539392,"internally_reserved":0,"allocated":917504,"data_stored":295295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.234,"5min":2.4289999999999998,"15min":2.5569999999999999},"min":{"1min":1.375,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":3.5539999999999998,"5min":10.148,"15min":10.148},"last":2.6379999999999999},{"interface":"front","average":{"1min":2.6800000000000002,"5min":2.7320000000000002,"15min":2.7400000000000002},"min":{"1min":1.444,"5min":1.4219999999999999,"15min":1.4219999999999999},"max":{"1min":4.2530000000000001,"5min":9.7279999999999998,"15min":9.7279999999999998},"last":1.3779999999999999}]},{"osd":1,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":2.2269999999999999,"15min":2.2850000000000001},"min":{"1min":1.3819999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":2.915,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":2.052},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.9510000000000001,"15min":3.0009999999999999},"min":{"1min":1.4630000000000001,"5min":1.2889999999999999,"15min":1.2889999999999999},"max":{"1min":3.7120000000000002,"5min":11.179,"15min":11.179},"last":2.2069999999999999}]},{"osd":2,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":2.4500000000000002,"15min":2.5270000000000001},"min":{"1min":1.5840000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":2.851,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":1.6659999999999999},{"interface":"front","average":{"1min":2.3639999999999999,"5min":2.5739999999999998,"15min":2.7080000000000002},"min":{"1min":1.7529999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"max":{"1min":2.923,"5min":11.756,"15min":11.756},"last":1.5880000000000001}]},{"osd":3,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":3.0150000000000001,"5min":3.2669999999999999,"15min":3.3570000000000002},"min":{"1min":2.1549999999999998,"5min":1.075,"15min":1.075},"max":{"1min":3.879,"5min":10.316000000000001,"15min":10.316000000000001},"last":3.008},{"interface":"front","average":{"1min":2.8420000000000001,"5min":2.8650000000000002,"15min":2.931},"min":{"1min":1.8759999999999999,"5min":1.327,"15min":1.327},"max":{"1min":3.3660000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":2.5019999999999998}]},{"osd":4,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":2.7519999999999998,"15min":2.8740000000000001},"min":{"1min":1.4790000000000001,"5min":1.073,"15min":1.073},"max":{"1min":5.9619999999999997,"5min":10.954000000000001,"15min":10.954000000000001},"last":1.9770000000000001},{"interface":"front","average":{"1min":3.3359999999999999,"5min":3.5470000000000002,"15min":3.6459999999999999},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":4.7110000000000003,"5min":10.603,"15min":10.603},"last":3.4350000000000001}]},{"osd":5,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.7549999999999999,"5min":2.9830000000000001,"15min":3.1160000000000001},"min":{"1min":1.28,"5min":1.256,"15min":1.256},"max":{"1min":3.7069999999999999,"5min":10.816000000000001,"15min":10.816000000000001},"last":2.3679999999999999},{"interface":"front","average":{"1min":3.6520000000000001,"5min":3.7690000000000001,"15min":3.8849999999999998},"min":{"1min":1.925,"5min":1.7729999999999999,"15min":1.7729999999999999},"max":{"1min":5.117,"5min":10.849,"15min":10.849},"last":3.8359999999999999}]},{"osd":7,"last update":"Wed Jan 27 13:37:42 2021","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":3.8220000000000001,"15min":3.8620000000000001},"min":{"1min":1.706,"5min":1.706,"15min":1.706},"max":{"1min":4.8719999999999999,"5min":5.3490000000000002,"15min":5.3490000000000002},"last":4.2679999999999998},{"interface":"front","average":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"min":{"1min":1.55,"5min":1.4690000000000001,"15min":1.4690000000000001},"max":{"1min":3.9239999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":3.298}]}]},{"osd":1,"up_from":16,"seq":68719476808,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6780,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738372,"statfs":{"total":95995035648,"available":95988092928,"internally_reserved":0,"allocated":970752,"data_stored":297377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.8400000000000001,"15min":1.48},"min":{"1min":1.01,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":2.4649999999999999,"5min":2.0129999999999999,"15min":1.5780000000000001},"min":{"1min":1.3859999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":3.7559999999999998,"5min":3.7559999999999998,"15min":3.7559999999999998},"last":1.581}]},{"osd":2,"last update":"Wed Jan 27 13:38:34 2021","interfaces":[{"interface":"back","average":{"1min":2.6030000000000002,"5min":2.3780000000000001,"15min":2.1400000000000001},"min":{"1min":1.6910000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":2.0369999999999999},{"interface":"front","average":{"1min":2.3119999999999998,"5min":2.1579999999999999,"15min":1.958},"min":{"1min":1.518,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":3.2749999999999999,"5min":3.2749999999999999,"15min":3.2749999999999999},"last":1.518}]},{"osd":3,"last update":"Wed Jan 27 13:38:03 2021","interfaces":[{"interface":"back","average":{"1min":2.778,"5min":2.4849999999999999,"15min":2.3370000000000002},"min":{"1min":1.9399999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"max":{"1min":5.3769999999999998,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":1.792},{"interface":"front","average":{"1min":3.0289999999999999,"5min":2.6899999999999999,"15min":2.528},"min":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"max":{"1min":5.2069999999999999,"5min":5.2069999999999999,"15min":5.2069999999999999},"last":2.4209999999999998}]},{"osd":4,"last update":"Wed Jan 27 13:38:31 2021","interfaces":[{"interface":"back","average":{"1min":3.573,"5min":3.04,"15min":2.863},"min":{"1min":2.7250000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"max":{"1min":4.7939999999999996,"5min":4.8579999999999997,"15min":4.8579999999999997},"last":2.972},{"interface":"front","average":{"1min":3.6949999999999998,"5min":3.1819999999999999,"15min":2.9390000000000001},"min":{"1min":2.2200000000000002,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":5.8470000000000004,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":2.2189999999999999}]},{"osd":5,"last update":"Wed Jan 27 13:37:54 2021","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.1629999999999998,"15min":3.0569999999999999},"min":{"1min":1.754,"5min":1.754,"15min":1.754},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":3.1480000000000001},{"interface":"front","average":{"1min":3.419,"5min":3.3759999999999999,"15min":3.3359999999999999},"min":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"max":{"1min":4.4749999999999996,"5min":4.6189999999999998,"15min":4.6189999999999998},"last":3.3180000000000001}]},{"osd":6,"last update":"Wed Jan 27 13:38:17 2021","interfaces":[{"interface":"back","average":{"1min":3.8540000000000001,"5min":3.6059999999999999,"15min":3.5569999999999999},"min":{"1min":2.6850000000000001,"5min":2.1379999999999999,"15min":2.1379999999999999},"max":{"1min":6.2569999999999997,"5min":6.2569999999999997,"15min":6.2569999999999997},"last":2.9140000000000001},{"interface":"front","average":{"1min":3.8980000000000001,"5min":3.5950000000000002,"15min":3.5129999999999999},"min":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"max":{"1min":5.0659999999999998,"5min":5.0659999999999998,"15min":5.0659999999999998},"last":3.6160000000000001}]},{"osd":7,"last update":"Wed Jan 27 13:37:40 2021","interfaces":[{"interface":"back","average":{"1min":3.8780000000000001,"5min":3.7919999999999998,"15min":3.778},"min":{"1min":2.5920000000000001,"5min":2.5299999999999998,"15min":2.5299999999999998},"max":{"1min":5.2910000000000004,"5min":5.2910000000000004,"15min":5.2910000000000004},"last":3.2679999999999998},{"interface":"front","average":{"1min":4.0209999999999999,"5min":3.9039999999999999,"15min":3.8839999999999999},"min":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"max":{"1min":5.1870000000000003,"5min":5.1870000000000003,"15min":5.1870000000000003},"last":4.0190000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673038,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6476,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738676,"statfs":{"total":95995035648,"available":95988404224,"internally_reserved":0,"allocated":856064,"data_stored":293606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.0129999999999999,"5min":1.889,"15min":1.532},"min":{"1min":0.999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.778,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.966},{"interface":"front","average":{"1min":2.0190000000000001,"5min":1.853,"15min":1.5529999999999999},"min":{"1min":1.2,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.6930000000000001,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":2.0920000000000001}]},{"osd":2,"last update":"Wed Jan 27 13:38:34 2021","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":2.3220000000000001,"15min":2.0590000000000002},"min":{"1min":1.4379999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.6600000000000001,"5min":3.6600000000000001,"15min":3.6600000000000001},"last":2.6120000000000001},{"interface":"front","average":{"1min":2.383,"5min":2.1419999999999999,"15min":1.9770000000000001},"min":{"1min":1.401,"5min":1.1719999999999999,"15min":1.1719999999999999},"max":{"1min":3.129,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":2.4100000000000001}]},{"osd":3,"last update":"Wed Jan 27 13:38:00 2021","interfaces":[{"interface":"back","average":{"1min":2.3919999999999999,"5min":2.3740000000000001,"15min":2.3100000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.177,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":2.6800000000000002},{"interface":"front","average":{"1min":2.8570000000000002,"5min":2.8069999999999999,"15min":2.722},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":2.8540000000000001}]},{"osd":4,"last update":"Wed Jan 27 13:38:29 2021","interfaces":[{"interface":"back","average":{"1min":2.8849999999999998,"5min":2.585,"15min":2.4910000000000001},"min":{"1min":1.3620000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":2.5619999999999998},{"interface":"front","average":{"1min":3.552,"5min":3.2669999999999999,"15min":3.0630000000000002},"min":{"1min":1.8759999999999999,"5min":1.641,"15min":1.641},"max":{"1min":4.6840000000000002,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":3.161}]},{"osd":5,"last update":"Wed Jan 27 13:37:52 2021","interfaces":[{"interface":"back","average":{"1min":2.9900000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"min":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"max":{"1min":3.7320000000000002,"5min":4.516,"15min":4.516},"last":3.3570000000000002},{"interface":"front","average":{"1min":2.9969999999999999,"5min":3.0710000000000002,"15min":3.0710000000000002},"min":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":3.2229999999999999}]},{"osd":6,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":3.6320000000000001,"5min":3.6309999999999998,"15min":3.621},"min":{"1min":1.9630000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"max":{"1min":4.6529999999999996,"5min":5.9500000000000002,"15min":5.9500000000000002},"last":3.4300000000000002},{"interface":"front","average":{"1min":3.2959999999999998,"5min":3.2949999999999999,"15min":3.242},"min":{"1min":1.865,"5min":1.865,"15min":1.865},"max":{"1min":4.3259999999999996,"5min":4.3799999999999999,"15min":4.3799999999999999},"last":3.9489999999999998}]},{"osd":7,"last update":"Wed Jan 27 13:37:38 2021","interfaces":[{"interface":"back","average":{"1min":3.9830000000000001,"5min":3.8849999999999998,"15min":3.8690000000000002},"min":{"1min":2.669,"5min":1.9970000000000001,"15min":1.9970000000000001},"max":{"1min":7.5270000000000001,"5min":7.5270000000000001,"15min":7.5270000000000001},"last":3.6619999999999999},{"interface":"front","average":{"1min":3.722,"5min":3.629,"15min":3.613},"min":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"max":{"1min":6.0759999999999996,"5min":6.0759999999999996,"15min":6.0759999999999996},"last":4.2050000000000001}]}]},{"osd":2,"up_from":21,"seq":90194313281,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6308,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738844,"statfs":{"total":95995035648,"available":95988576256,"internally_reserved":0,"allocated":815104,"data_stored":291700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":1.964,"15min":1.6799999999999999},"min":{"1min":1.1779999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":3.0470000000000002,"5min":7.1399999999999997,"15min":7.1399999999999997},"last":2.3090000000000002},{"interface":"front","average":{"1min":2.1669999999999998,"5min":2.1619999999999999,"15min":1.8540000000000001},"min":{"1min":1.3540000000000001,"5min":1.204,"15min":1.204},"max":{"1min":2.7440000000000002,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":2.2240000000000002}]},{"osd":1,"last update":"Wed Jan 27 13:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.1560000000000001,"5min":2.157,"15min":1.9330000000000001},"min":{"1min":1.2390000000000001,"5min":1.105,"15min":1.105},"max":{"1min":2.9670000000000001,"5min":6.585,"15min":6.585},"last":2.4300000000000002},{"interface":"front","average":{"1min":2.5489999999999999,"5min":2.476,"15min":2.1459999999999999},"min":{"1min":1.548,"5min":1.3320000000000001,"15min":1.3320000000000001},"max":{"1min":3.105,"5min":4.157,"15min":4.157},"last":3.395}]},{"osd":3,"last update":"Wed Jan 27 13:38:04 2021","interfaces":[{"interface":"back","average":{"1min":2.7959999999999998,"5min":2.54,"15min":2.3439999999999999},"min":{"1min":2.1840000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":3.5430000000000001,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":3.1469999999999998},{"interface":"front","average":{"1min":2.8239999999999998,"5min":2.7549999999999999,"15min":2.577},"min":{"1min":2.2919999999999998,"5min":1.583,"15min":1.583},"max":{"1min":3.2869999999999999,"5min":7.7409999999999997,"15min":7.7409999999999997},"last":3.5710000000000002}]},{"osd":4,"last update":"Wed Jan 27 13:38:26 2021","interfaces":[{"interface":"back","average":{"1min":2.8420000000000001,"5min":2.863,"15min":2.7589999999999999},"min":{"1min":1.8759999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"max":{"1min":4.3550000000000004,"5min":7.056,"15min":7.056},"last":3.0790000000000002},{"interface":"front","average":{"1min":3.1960000000000002,"5min":3.161,"15min":3.0059999999999998},"min":{"1min":2.1629999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"max":{"1min":3.8929999999999998,"5min":9.3559999999999999,"15min":9.3559999999999999},"last":3.7879999999999998}]},{"osd":5,"last update":"Wed Jan 27 13:37:54 2021","interfaces":[{"interface":"back","average":{"1min":3.8399999999999999,"5min":3.4870000000000001,"15min":3.3340000000000001},"min":{"1min":3.1890000000000001,"5min":1.923,"15min":1.923},"max":{"1min":4.8929999999999998,"5min":8.4250000000000007,"15min":8.4250000000000007},"last":3.4940000000000002},{"interface":"front","average":{"1min":3.3330000000000002,"5min":3.2839999999999998,"15min":3.246},"min":{"1min":2.6960000000000002,"5min":2.048,"15min":2.048},"max":{"1min":3.9710000000000001,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":4.3209999999999997}]},{"osd":6,"last update":"Wed Jan 27 13:38:17 2021","interfaces":[{"interface":"back","average":{"1min":3.5910000000000002,"5min":3.71,"15min":3.762},"min":{"1min":2.3730000000000002,"5min":1.744,"15min":1.744},"max":{"1min":4.6959999999999997,"5min":5.1870000000000003,"15min":5.1870000000000003},"last":4.5510000000000002},{"interface":"front","average":{"1min":3.6190000000000002,"5min":3.7090000000000001,"15min":3.7610000000000001},"min":{"1min":2.5179999999999998,"5min":2.2949999999999999,"15min":2.2949999999999999},"max":{"1min":5.0490000000000004,"5min":7.2699999999999996,"15min":7.2699999999999996},"last":3.8490000000000002}]},{"osd":7,"last update":"Wed Jan 27 13:37:39 2021","interfaces":[{"interface":"back","average":{"1min":3.7069999999999999,"5min":4.0110000000000001,"15min":4.0620000000000003},"min":{"1min":3.032,"5min":2.3889999999999998,"15min":2.3889999999999998},"max":{"1min":4.444,"5min":6.5049999999999999,"15min":6.5049999999999999},"last":4.7889999999999997},{"interface":"front","average":{"1min":4,"5min":4.3029999999999999,"15min":4.3529999999999998},"min":{"1min":2.9620000000000002,"5min":2.3700000000000001,"15min":2.3700000000000001},"max":{"1min":4.843,"5min":9.1609999999999996,"15min":9.1609999999999996},"last":4.0279999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149755,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6584,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738568,"statfs":{"total":95995035648,"available":95988293632,"internally_reserved":0,"allocated":966656,"data_stored":297150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":1.9159999999999999,"15min":1.724},"min":{"1min":1.014,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":3.0289999999999999,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.0470000000000002},{"interface":"front","average":{"1min":2.1379999999999999,"5min":2.1030000000000002,"15min":2.0750000000000002},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":3.2450000000000001,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":3.9049999999999998}]},{"osd":1,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.4990000000000001,"5min":2.3010000000000002,"15min":2.1520000000000001},"min":{"1min":1.353,"5min":1.214,"15min":1.214},"max":{"1min":3.3599999999999999,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":2.2200000000000002},{"interface":"front","average":{"1min":2.3679999999999999,"5min":2.2730000000000001,"15min":2.2250000000000001},"min":{"1min":1.952,"5min":1.133,"15min":1.133},"max":{"1min":3.1760000000000002,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":2.5550000000000002}]},{"osd":2,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.3919999999999999,"5min":2.3370000000000002,"15min":2.3490000000000002},"min":{"1min":1.6080000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.6280000000000001,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":5.0270000000000001},{"interface":"front","average":{"1min":2.8599999999999999,"5min":2.6579999999999999,"15min":2.4740000000000002},"min":{"1min":2.1349999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"max":{"1min":3.722,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":2.911}]},{"osd":4,"last update":"Wed Jan 27 13:38:23 2021","interfaces":[{"interface":"back","average":{"1min":3.4830000000000001,"5min":3.0920000000000001,"15min":2.79},"min":{"1min":2.2770000000000001,"5min":1.359,"15min":1.359},"max":{"1min":5.8440000000000003,"5min":5.8440000000000003,"15min":5.8440000000000003},"last":3.3420000000000001},{"interface":"front","average":{"1min":3.3660000000000001,"5min":3.129,"15min":2.9329999999999998},"min":{"1min":2.1440000000000001,"5min":1.651,"15min":1.651},"max":{"1min":4.7030000000000003,"5min":4.9870000000000001,"15min":4.9870000000000001},"last":3.4929999999999999}]},{"osd":5,"last update":"Wed Jan 27 13:37:51 2021","interfaces":[{"interface":"back","average":{"1min":3.4630000000000001,"5min":3.3260000000000001,"15min":3.2999999999999998},"min":{"1min":2.5289999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"max":{"1min":4.4370000000000003,"5min":5.0720000000000001,"15min":5.0720000000000001},"last":3.0150000000000001},{"interface":"front","average":{"1min":3.6880000000000002,"5min":3.3929999999999998,"15min":3.3010000000000002},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":4.984,"5min":4.984,"15min":4.984},"last":3.8069999999999999}]},{"osd":6,"last update":"Wed Jan 27 13:38:19 2021","interfaces":[{"interface":"back","average":{"1min":3.714,"5min":3.7000000000000002,"15min":3.698},"min":{"1min":2.2120000000000002,"5min":1.8049999999999999,"15min":1.8049999999999999},"max":{"1min":4.79,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":4.4050000000000002},{"interface":"front","average":{"1min":3.3439999999999999,"5min":3.2309999999999999,"15min":3.2069999999999999},"min":{"1min":2.0819999999999999,"5min":1.867,"15min":1.867},"max":{"1min":4.2480000000000002,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":5.4870000000000001}]},{"osd":7,"last update":"Wed Jan 27 13:37:43 2021","interfaces":[{"interface":"back","average":{"1min":3.774,"5min":3.6699999999999999,"15min":3.653},"min":{"1min":2.4449999999999998,"5min":2.1720000000000002,"15min":2.1720000000000002},"max":{"1min":5.3369999999999997,"5min":5.3369999999999997,"15min":5.3369999999999997},"last":4.2370000000000001},{"interface":"front","average":{"1min":3.7320000000000002,"5min":3.8860000000000001,"15min":3.9119999999999999},"min":{"1min":2.4129999999999998,"5min":2.024,"15min":2.024},"max":{"1min":4.9340000000000002,"5min":5.0999999999999996,"15min":5.0999999999999996},"last":4.8559999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6484,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738668,"statfs":{"total":95995035648,"available":95988396032,"internally_reserved":0,"allocated":929792,"data_stored":296271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:24 2021","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.0249999999999999,"15min":1.8839999999999999},"min":{"1min":1.2789999999999999,"5min":1.228,"15min":1.228},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":3.4849999999999999},{"interface":"front","average":{"1min":2.2210000000000001,"5min":2.077,"15min":1.925},"min":{"1min":1.321,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":4.8719999999999999,"5min":6.8949999999999996,"15min":6.8949999999999996},"last":1.3939999999999999}]},{"osd":1,"last update":"Wed Jan 27 13:38:24 2021","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":2.0840000000000001,"15min":1.9450000000000001},"min":{"1min":1.6060000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"max":{"1min":2.5350000000000001,"5min":9.1980000000000004,"15min":9.1980000000000004},"last":1.2829999999999999},{"interface":"front","average":{"1min":2.7130000000000001,"5min":2.4260000000000002,"15min":2.2330000000000001},"min":{"1min":1.3859999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"max":{"1min":5.6050000000000004,"5min":5.6050000000000004,"15min":5.6050000000000004},"last":2.8849999999999998}]},{"osd":2,"last update":"Wed Jan 27 13:38:24 2021","interfaces":[{"interface":"back","average":{"1min":2.911,"5min":2.488,"15min":2.262},"min":{"1min":1.6140000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"max":{"1min":5.3739999999999997,"5min":5.8029999999999999,"15min":5.8029999999999999},"last":2.419},{"interface":"front","average":{"1min":2.7719999999999998,"5min":2.6659999999999999,"15min":2.5089999999999999},"min":{"1min":1.8759999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"max":{"1min":5.3220000000000001,"5min":6.5179999999999998,"15min":6.5179999999999998},"last":1.6950000000000001}]},{"osd":3,"last update":"Wed Jan 27 13:38:24 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":2.7130000000000001,"15min":2.5190000000000001},"min":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":4.4320000000000004,"5min":6.7149999999999999,"15min":6.7149999999999999},"last":3.2690000000000001},{"interface":"front","average":{"1min":2.7370000000000001,"5min":2.552,"15min":2.3620000000000001},"min":{"1min":1.798,"5min":1.74,"15min":1.74},"max":{"1min":3.9279999999999999,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":2.7250000000000001}]},{"osd":5,"last update":"Wed Jan 27 13:37:52 2021","interfaces":[{"interface":"back","average":{"1min":3.0680000000000001,"5min":2.5979999999999999,"15min":2.4980000000000002},"min":{"1min":1.5660000000000001,"5min":1.355,"15min":1.355},"max":{"1min":7.9749999999999996,"5min":7.9749999999999996,"15min":7.9749999999999996},"last":2.5169999999999999},{"interface":"front","average":{"1min":3.0979999999999999,"5min":2.7679999999999998,"15min":2.7269999999999999},"min":{"1min":1.409,"5min":1.409,"15min":1.409},"max":{"1min":5.6239999999999997,"5min":5.6239999999999997,"15min":5.6239999999999997},"last":2.6179999999999999}]},{"osd":6,"last update":"Wed Jan 27 13:38:18 2021","interfaces":[{"interface":"back","average":{"1min":3.456,"5min":3.2109999999999999,"15min":3.1850000000000001},"min":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":5.9610000000000003,"5min":5.9610000000000003,"15min":5.9610000000000003},"last":2.5790000000000002},{"interface":"front","average":{"1min":3.5979999999999999,"5min":3.4500000000000002,"15min":3.4460000000000002},"min":{"1min":1.347,"5min":1.347,"15min":1.347},"max":{"1min":5.7880000000000003,"5min":7.077,"15min":7.077},"last":1.5449999999999999}]},{"osd":7,"last update":"Wed Jan 27 13:37:38 2021","interfaces":[{"interface":"back","average":{"1min":3.4359999999999999,"5min":3.2759999999999998,"15min":3.2490000000000001},"min":{"1min":2.52,"5min":1.389,"15min":1.389},"max":{"1min":6.569,"5min":6.569,"15min":6.569},"last":1.4219999999999999},{"interface":"front","average":{"1min":3.5310000000000001,"5min":3.4430000000000001,"15min":3.4289999999999998},"min":{"1min":2.48,"5min":1.889,"15min":1.889},"max":{"1min":6.6029999999999998,"5min":6.6029999999999998,"15min":6.6029999999999998},"last":2.75}]}]},{"osd":5,"up_from":36,"seq":154618822706,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6248,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738904,"statfs":{"total":95995035648,"available":95988637696,"internally_reserved":0,"allocated":819200,"data_stored":291668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.2149999999999999,"5min":1.958,"15min":1.8959999999999999},"min":{"1min":1.522,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":3.4449999999999998,"5min":3.75,"15min":3.75},"last":1.4910000000000001},{"interface":"front","average":{"1min":2.3570000000000002,"5min":2.0630000000000002,"15min":2.0169999999999999},"min":{"1min":1.5449999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":1.9470000000000001}]},{"osd":1,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.2999999999999998,"5min":2.1019999999999999,"15min":2.0249999999999999},"min":{"1min":1.6779999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":1.8280000000000001},{"interface":"front","average":{"1min":2.46,"5min":2.6349999999999998,"15min":2.6850000000000001},"min":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"max":{"1min":3.8370000000000002,"5min":9.8770000000000007,"15min":9.8770000000000007},"last":2.5640000000000001}]},{"osd":2,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":2.2589999999999999,"15min":2.117},"min":{"1min":1.903,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":2.9089999999999998},{"interface":"front","average":{"1min":2.7130000000000001,"5min":2.395,"15min":2.2669999999999999},"min":{"1min":1.734,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":3.6629999999999998,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":2.3149999999999999}]},{"osd":3,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":2.6179999999999999,"15min":2.5049999999999999},"min":{"1min":2.0059999999999998,"5min":1.298,"15min":1.298},"max":{"1min":3.9159999999999999,"5min":4.2290000000000001,"15min":4.2290000000000001},"last":2.6739999999999999},{"interface":"front","average":{"1min":2.9409999999999998,"5min":2.6429999999999998,"15min":2.4769999999999999},"min":{"1min":1.6699999999999999,"5min":1.605,"15min":1.605},"max":{"1min":4.0759999999999996,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":2.7290000000000001}]},{"osd":4,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":2.5089999999999999,"15min":2.3799999999999999},"min":{"1min":1.2729999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":5.1269999999999998,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":2.9809999999999999},{"interface":"front","average":{"1min":3.3170000000000002,"5min":2.782,"15min":2.5920000000000001},"min":{"1min":1.7509999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":4.8940000000000001,"5min":4.8959999999999999,"15min":4.8959999999999999},"last":3.1909999999999998}]},{"osd":6,"last update":"Wed Jan 27 13:38:15 2021","interfaces":[{"interface":"back","average":{"1min":3.4169999999999998,"5min":3.1459999999999999,"15min":3.0369999999999999},"min":{"1min":1.889,"5min":1.107,"15min":1.107},"max":{"1min":4.492,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":3.302},{"interface":"front","average":{"1min":3.6520000000000001,"5min":3.3610000000000002,"15min":3.2400000000000002},"min":{"1min":2.8570000000000002,"5min":1.591,"15min":1.591},"max":{"1min":4.835,"5min":5.2199999999999998,"15min":5.2199999999999998},"last":3.4329999999999998}]},{"osd":7,"last update":"Wed Jan 27 13:37:42 2021","interfaces":[{"interface":"back","average":{"1min":3.3159999999999998,"5min":3.2829999999999999,"15min":3.2770000000000001},"min":{"1min":1.833,"5min":1.5029999999999999,"15min":1.5029999999999999},"max":{"1min":4.1580000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":3.1230000000000002},{"interface":"front","average":{"1min":3.605,"5min":3.5099999999999998,"15min":3.4940000000000002},"min":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":3.5070000000000001}]}]}]}} 2021-01-27T13:38:42.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph pg dump --format=json 2021-01-27T13:38:43.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:42 smithi099 bash[9889]: audit 2021-01-27T13:38:42.034127+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T13:38:43.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:42 smithi037 bash[9724]: audit 2021-01-27T13:38:42.034127+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T13:38:43.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:42 smithi037 bash[13442]: audit 2021-01-27T13:38:42.034127+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T13:38:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:44.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:43 smithi099 bash[9889]: cluster 2021-01-27T13:38:42.222297+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:44.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:43 smithi037 bash[9724]: cluster 2021-01-27T13:38:42.222297+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:44.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:43 smithi037 bash[13442]: cluster 2021-01-27T13:38:42.222297+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:46.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:45 smithi099 bash[9889]: cluster 2021-01-27T13:38:44.223563+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:46.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:45 smithi037 bash[9724]: cluster 2021-01-27T13:38:44.223563+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:46.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:45 smithi037 bash[13442]: cluster 2021-01-27T13:38:44.223563+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:46.510 INFO:teuthology.orchestra.run.smithi037.stdout: 2021-01-27T13:38:46.514 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2021-01-27T13:38:47.332 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2021-01-27T13:38:46.223855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":1257,"num_read_kb":757,"num_write":567,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":3138,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":51452,"kb_used_data":6972,"kb_used_omap":0,"kb_used_meta":44416,"kb_avail":749909764,"statfs":{"total":767960285184,"available":767907598336,"internally_reserved":0,"allocated":7139328,"data_stored":2357214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45481984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006528"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.914665+0000","last_change":"2021-01-27T13:35:59.862068+0000","last_active":"2021-01-27T13:36:14.914665+0000","last_peered":"2021-01-27T13:36:14.914665+0000","last_clean":"2021-01-27T13:36:14.914665+0000","last_became_active":"2021-01-27T13:35:59.861426+0000","last_became_peered":"2021-01-27T13:35:59.861426+0000","last_unstale":"2021-01-27T13:36:14.914665+0000","last_undegraded":"2021-01-27T13:36:14.914665+0000","last_fullsized":"2021-01-27T13:36:14.914665+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.919731+0000","last_change":"2021-01-27T13:35:56.826752+0000","last_active":"2021-01-27T13:36:14.919731+0000","last_peered":"2021-01-27T13:36:14.919731+0000","last_clean":"2021-01-27T13:36:14.919731+0000","last_became_active":"2021-01-27T13:35:56.826361+0000","last_became_peered":"2021-01-27T13:35:56.826361+0000","last_unstale":"2021-01-27T13:36:14.919731+0000","last_undegraded":"2021-01-27T13:36:14.919731+0000","last_fullsized":"2021-01-27T13:36:14.919731+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"49'3","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923058+0000","last_change":"2021-01-27T13:35:39.191186+0000","last_active":"2021-01-27T13:36:14.923058+0000","last_peered":"2021-01-27T13:36:14.923058+0000","last_clean":"2021-01-27T13:36:14.923058+0000","last_became_active":"2021-01-27T13:35:39.190631+0000","last_became_peered":"2021-01-27T13:35:39.190631+0000","last_unstale":"2021-01-27T13:36:14.923058+0000","last_undegraded":"2021-01-27T13:36:14.923058+0000","last_fullsized":"2021-01-27T13:36:14.923058+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'20","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916922+0000","last_change":"2021-01-27T13:35:54.800395+0000","last_active":"2021-01-27T13:36:14.916922+0000","last_peered":"2021-01-27T13:36:14.916922+0000","last_clean":"2021-01-27T13:36:14.916922+0000","last_became_active":"2021-01-27T13:35:54.799975+0000","last_became_peered":"2021-01-27T13:35:54.799975+0000","last_unstale":"2021-01-27T13:36:14.916922+0000","last_undegraded":"2021-01-27T13:36:14.916922+0000","last_fullsized":"2021-01-27T13:36:14.916922+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":22,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920045+0000","last_change":"2021-01-27T13:35:59.859002+0000","last_active":"2021-01-27T13:36:14.920045+0000","last_peered":"2021-01-27T13:36:14.920045+0000","last_clean":"2021-01-27T13:36:14.920045+0000","last_became_active":"2021-01-27T13:35:59.858378+0000","last_became_peered":"2021-01-27T13:35:59.858378+0000","last_unstale":"2021-01-27T13:36:14.920045+0000","last_undegraded":"2021-01-27T13:36:14.920045+0000","last_fullsized":"2021-01-27T13:36:14.920045+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918342+0000","last_change":"2021-01-27T13:35:56.826700+0000","last_active":"2021-01-27T13:36:14.918342+0000","last_peered":"2021-01-27T13:36:14.918342+0000","last_clean":"2021-01-27T13:36:14.918342+0000","last_became_active":"2021-01-27T13:35:56.826248+0000","last_became_peered":"2021-01-27T13:35:56.826248+0000","last_unstale":"2021-01-27T13:36:14.918342+0000","last_undegraded":"2021-01-27T13:36:14.918342+0000","last_fullsized":"2021-01-27T13:36:14.918342+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917801+0000","last_change":"2021-01-27T13:35:35.150503+0000","last_active":"2021-01-27T13:36:14.917801+0000","last_peered":"2021-01-27T13:36:14.917801+0000","last_clean":"2021-01-27T13:36:14.917801+0000","last_became_active":"2021-01-27T13:35:35.150050+0000","last_became_peered":"2021-01-27T13:35:35.150050+0000","last_unstale":"2021-01-27T13:36:14.917801+0000","last_undegraded":"2021-01-27T13:36:14.917801+0000","last_fullsized":"2021-01-27T13:36:14.917801+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"60'15","reported_seq":"77","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:36:16.390280+0000","last_change":"2021-01-27T13:36:16.390280+0000","last_active":"2021-01-27T13:36:16.390280+0000","last_peered":"2021-01-27T13:36:16.390280+0000","last_clean":"2021-01-27T13:36:16.390280+0000","last_became_active":"2021-01-27T13:36:15.932365+0000","last_became_peered":"2021-01-27T13:36:15.932365+0000","last_unstale":"2021-01-27T13:36:16.390280+0000","last_undegraded":"2021-01-27T13:36:16.390280+0000","last_fullsized":"2021-01-27T13:36:16.390280+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923651+0000","last_change":"2021-01-27T13:35:59.867967+0000","last_active":"2021-01-27T13:36:14.923651+0000","last_peered":"2021-01-27T13:36:14.923651+0000","last_clean":"2021-01-27T13:36:14.923651+0000","last_became_active":"2021-01-27T13:35:59.867548+0000","last_became_peered":"2021-01-27T13:35:59.867548+0000","last_unstale":"2021-01-27T13:36:14.923651+0000","last_undegraded":"2021-01-27T13:36:14.923651+0000","last_fullsized":"2021-01-27T13:36:14.923651+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929362+0000","last_change":"2021-01-27T13:35:56.831867+0000","last_active":"2021-01-27T13:36:14.929362+0000","last_peered":"2021-01-27T13:36:14.929362+0000","last_clean":"2021-01-27T13:36:14.929362+0000","last_became_active":"2021-01-27T13:35:56.831484+0000","last_became_peered":"2021-01-27T13:35:56.831484+0000","last_unstale":"2021-01-27T13:36:14.929362+0000","last_undegraded":"2021-01-27T13:36:14.929362+0000","last_fullsized":"2021-01-27T13:36:14.929362+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929867+0000","last_change":"2021-01-27T13:35:39.196666+0000","last_active":"2021-01-27T13:36:14.929867+0000","last_peered":"2021-01-27T13:36:14.929867+0000","last_clean":"2021-01-27T13:36:14.929867+0000","last_became_active":"2021-01-27T13:35:39.196201+0000","last_became_peered":"2021-01-27T13:35:39.196201+0000","last_unstale":"2021-01-27T13:36:14.929867+0000","last_undegraded":"2021-01-27T13:36:14.929867+0000","last_fullsized":"2021-01-27T13:36:14.929867+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"60'6","reported_seq":"30","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921217+0000","last_change":"2021-01-27T13:35:54.803812+0000","last_active":"2021-01-27T13:36:14.921217+0000","last_peered":"2021-01-27T13:36:14.921217+0000","last_clean":"2021-01-27T13:36:14.921217+0000","last_became_active":"2021-01-27T13:35:54.803352+0000","last_became_peered":"2021-01-27T13:35:54.803352+0000","last_unstale":"2021-01-27T13:36:14.921217+0000","last_undegraded":"2021-01-27T13:36:14.921217+0000","last_fullsized":"2021-01-27T13:36:14.921217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923126+0000","last_change":"2021-01-27T13:35:59.852350+0000","last_active":"2021-01-27T13:36:14.923126+0000","last_peered":"2021-01-27T13:36:14.923126+0000","last_clean":"2021-01-27T13:36:14.923126+0000","last_became_active":"2021-01-27T13:35:59.851865+0000","last_became_peered":"2021-01-27T13:35:59.851865+0000","last_unstale":"2021-01-27T13:36:14.923126+0000","last_undegraded":"2021-01-27T13:36:14.923126+0000","last_fullsized":"2021-01-27T13:36:14.923126+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924439+0000","last_change":"2021-01-27T13:35:56.821343+0000","last_active":"2021-01-27T13:36:14.924439+0000","last_peered":"2021-01-27T13:36:14.924439+0000","last_clean":"2021-01-27T13:36:14.924439+0000","last_became_active":"2021-01-27T13:35:56.820944+0000","last_became_peered":"2021-01-27T13:35:56.820944+0000","last_unstale":"2021-01-27T13:36:14.924439+0000","last_undegraded":"2021-01-27T13:36:14.924439+0000","last_fullsized":"2021-01-27T13:36:14.924439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929745+0000","last_change":"2021-01-27T13:35:39.198223+0000","last_active":"2021-01-27T13:36:14.929745+0000","last_peered":"2021-01-27T13:36:14.929745+0000","last_clean":"2021-01-27T13:36:14.929745+0000","last_became_active":"2021-01-27T13:35:39.197282+0000","last_became_peered":"2021-01-27T13:35:39.197282+0000","last_unstale":"2021-01-27T13:36:14.929745+0000","last_undegraded":"2021-01-27T13:36:14.929745+0000","last_fullsized":"2021-01-27T13:36:14.929745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"60'13","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920142+0000","last_change":"2021-01-27T13:35:54.798979+0000","last_active":"2021-01-27T13:36:14.920142+0000","last_peered":"2021-01-27T13:36:14.920142+0000","last_clean":"2021-01-27T13:36:14.920142+0000","last_became_active":"2021-01-27T13:35:54.798573+0000","last_became_peered":"2021-01-27T13:35:54.798573+0000","last_unstale":"2021-01-27T13:36:14.920142+0000","last_undegraded":"2021-01-27T13:36:14.920142+0000","last_fullsized":"2021-01-27T13:36:14.920142+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917749+0000","last_change":"2021-01-27T13:35:59.864933+0000","last_active":"2021-01-27T13:36:14.917749+0000","last_peered":"2021-01-27T13:36:14.917749+0000","last_clean":"2021-01-27T13:36:14.917749+0000","last_became_active":"2021-01-27T13:35:59.864530+0000","last_became_peered":"2021-01-27T13:35:59.864530+0000","last_unstale":"2021-01-27T13:36:14.917749+0000","last_undegraded":"2021-01-27T13:36:14.917749+0000","last_fullsized":"2021-01-27T13:36:14.917749+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922115+0000","last_change":"2021-01-27T13:35:56.826924+0000","last_active":"2021-01-27T13:36:14.922115+0000","last_peered":"2021-01-27T13:36:14.922115+0000","last_clean":"2021-01-27T13:36:14.922115+0000","last_became_active":"2021-01-27T13:35:56.826461+0000","last_became_peered":"2021-01-27T13:35:56.826461+0000","last_unstale":"2021-01-27T13:36:14.922115+0000","last_undegraded":"2021-01-27T13:36:14.922115+0000","last_fullsized":"2021-01-27T13:36:14.922115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.914852+0000","last_change":"2021-01-27T13:35:39.190382+0000","last_active":"2021-01-27T13:36:14.914852+0000","last_peered":"2021-01-27T13:36:14.914852+0000","last_clean":"2021-01-27T13:36:14.914852+0000","last_became_active":"2021-01-27T13:35:39.189764+0000","last_became_peered":"2021-01-27T13:35:39.189764+0000","last_unstale":"2021-01-27T13:36:14.914852+0000","last_undegraded":"2021-01-27T13:36:14.914852+0000","last_fullsized":"2021-01-27T13:36:14.914852+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"60'16","reported_seq":"49","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917323+0000","last_change":"2021-01-27T13:35:54.800778+0000","last_active":"2021-01-27T13:36:14.917323+0000","last_peered":"2021-01-27T13:36:14.917323+0000","last_clean":"2021-01-27T13:36:14.917323+0000","last_became_active":"2021-01-27T13:35:54.800218+0000","last_became_peered":"2021-01-27T13:35:54.800218+0000","last_unstale":"2021-01-27T13:36:14.917323+0000","last_undegraded":"2021-01-27T13:36:14.917323+0000","last_fullsized":"2021-01-27T13:36:14.917323+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":20,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923759+0000","last_change":"2021-01-27T13:35:59.857197+0000","last_active":"2021-01-27T13:36:14.923759+0000","last_peered":"2021-01-27T13:36:14.923759+0000","last_clean":"2021-01-27T13:36:14.923759+0000","last_became_active":"2021-01-27T13:35:59.856836+0000","last_became_peered":"2021-01-27T13:35:59.856836+0000","last_unstale":"2021-01-27T13:36:14.923759+0000","last_undegraded":"2021-01-27T13:36:14.923759+0000","last_fullsized":"2021-01-27T13:36:14.923759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923603+0000","last_change":"2021-01-27T13:35:56.828171+0000","last_active":"2021-01-27T13:36:14.923603+0000","last_peered":"2021-01-27T13:36:14.923603+0000","last_clean":"2021-01-27T13:36:14.923603+0000","last_became_active":"2021-01-27T13:35:56.827772+0000","last_became_peered":"2021-01-27T13:35:56.827772+0000","last_unstale":"2021-01-27T13:36:14.923603+0000","last_undegraded":"2021-01-27T13:36:14.923603+0000","last_fullsized":"2021-01-27T13:36:14.923603+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"45'1","reported_seq":"41","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924941+0000","last_change":"2021-01-27T13:35:39.208088+0000","last_active":"2021-01-27T13:36:14.924941+0000","last_peered":"2021-01-27T13:36:14.924941+0000","last_clean":"2021-01-27T13:36:14.924941+0000","last_became_active":"2021-01-27T13:35:39.189089+0000","last_became_peered":"2021-01-27T13:35:39.189089+0000","last_unstale":"2021-01-27T13:36:14.924941+0000","last_undegraded":"2021-01-27T13:36:14.924941+0000","last_fullsized":"2021-01-27T13:36:14.924941+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":"43","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921145+0000","last_change":"2021-01-27T13:35:54.801633+0000","last_active":"2021-01-27T13:36:14.921145+0000","last_peered":"2021-01-27T13:36:14.921145+0000","last_clean":"2021-01-27T13:36:14.921145+0000","last_became_active":"2021-01-27T13:35:54.801200+0000","last_became_peered":"2021-01-27T13:35:54.801200+0000","last_unstale":"2021-01-27T13:36:14.921145+0000","last_undegraded":"2021-01-27T13:36:14.921145+0000","last_fullsized":"2021-01-27T13:36:14.921145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923144+0000","last_change":"2021-01-27T13:35:59.864062+0000","last_active":"2021-01-27T13:36:14.923144+0000","last_peered":"2021-01-27T13:36:14.923144+0000","last_clean":"2021-01-27T13:36:14.923144+0000","last_became_active":"2021-01-27T13:35:59.863311+0000","last_became_peered":"2021-01-27T13:35:59.863311+0000","last_unstale":"2021-01-27T13:36:14.923144+0000","last_undegraded":"2021-01-27T13:36:14.923144+0000","last_fullsized":"2021-01-27T13:36:14.923144+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923513+0000","last_change":"2021-01-27T13:35:56.819871+0000","last_active":"2021-01-27T13:36:14.923513+0000","last_peered":"2021-01-27T13:36:14.923513+0000","last_clean":"2021-01-27T13:36:14.923513+0000","last_became_active":"2021-01-27T13:35:56.819326+0000","last_became_peered":"2021-01-27T13:35:56.819326+0000","last_unstale":"2021-01-27T13:36:14.923513+0000","last_undegraded":"2021-01-27T13:36:14.923513+0000","last_fullsized":"2021-01-27T13:36:14.923513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"49'1","reported_seq":"28","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916550+0000","last_change":"2021-01-27T13:35:35.151767+0000","last_active":"2021-01-27T13:36:14.916550+0000","last_peered":"2021-01-27T13:36:14.916550+0000","last_clean":"2021-01-27T13:36:14.916550+0000","last_became_active":"2021-01-27T13:35:35.151283+0000","last_became_peered":"2021-01-27T13:35:35.151283+0000","last_unstale":"2021-01-27T13:36:14.916550+0000","last_undegraded":"2021-01-27T13:36:14.916550+0000","last_fullsized":"2021-01-27T13:36:14.916550+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'17","reported_seq":"49","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.926030+0000","last_change":"2021-01-27T13:35:54.805392+0000","last_active":"2021-01-27T13:36:14.926030+0000","last_peered":"2021-01-27T13:36:14.926030+0000","last_clean":"2021-01-27T13:36:14.926030+0000","last_became_active":"2021-01-27T13:35:54.804981+0000","last_became_peered":"2021-01-27T13:35:54.804981+0000","last_unstale":"2021-01-27T13:36:14.926030+0000","last_undegraded":"2021-01-27T13:36:14.926030+0000","last_fullsized":"2021-01-27T13:36:14.926030+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":19,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.930222+0000","last_change":"2021-01-27T13:35:59.849632+0000","last_active":"2021-01-27T13:36:14.930222+0000","last_peered":"2021-01-27T13:36:14.930222+0000","last_clean":"2021-01-27T13:36:14.930222+0000","last_became_active":"2021-01-27T13:35:59.849080+0000","last_became_peered":"2021-01-27T13:35:59.849080+0000","last_unstale":"2021-01-27T13:36:14.930222+0000","last_undegraded":"2021-01-27T13:36:14.930222+0000","last_fullsized":"2021-01-27T13:36:14.930222+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.947236+0000","last_change":"2021-01-27T13:35:56.830110+0000","last_active":"2021-01-27T13:38:37.947236+0000","last_peered":"2021-01-27T13:38:37.947236+0000","last_clean":"2021-01-27T13:38:37.947236+0000","last_became_active":"2021-01-27T13:35:56.829741+0000","last_became_peered":"2021-01-27T13:35:56.829741+0000","last_unstale":"2021-01-27T13:38:37.947236+0000","last_undegraded":"2021-01-27T13:38:37.947236+0000","last_fullsized":"2021-01-27T13:38:37.947236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923430+0000","last_change":"2021-01-27T13:35:39.197219+0000","last_active":"2021-01-27T13:36:14.923430+0000","last_peered":"2021-01-27T13:36:14.923430+0000","last_clean":"2021-01-27T13:36:14.923430+0000","last_became_active":"2021-01-27T13:35:39.196715+0000","last_became_peered":"2021-01-27T13:35:39.196715+0000","last_unstale":"2021-01-27T13:36:14.923430+0000","last_undegraded":"2021-01-27T13:36:14.923430+0000","last_fullsized":"2021-01-27T13:36:14.923430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"60'16","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923394+0000","last_change":"2021-01-27T13:35:54.864619+0000","last_active":"2021-01-27T13:36:14.923394+0000","last_peered":"2021-01-27T13:36:14.923394+0000","last_clean":"2021-01-27T13:36:14.923394+0000","last_became_active":"2021-01-27T13:35:54.863091+0000","last_became_peered":"2021-01-27T13:35:54.863091+0000","last_unstale":"2021-01-27T13:36:14.923394+0000","last_undegraded":"2021-01-27T13:36:14.923394+0000","last_fullsized":"2021-01-27T13:36:14.923394+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915484+0000","last_change":"2021-01-27T13:35:59.861814+0000","last_active":"2021-01-27T13:36:14.915484+0000","last_peered":"2021-01-27T13:36:14.915484+0000","last_clean":"2021-01-27T13:36:14.915484+0000","last_became_active":"2021-01-27T13:35:59.860848+0000","last_became_peered":"2021-01-27T13:35:59.860848+0000","last_unstale":"2021-01-27T13:36:14.915484+0000","last_undegraded":"2021-01-27T13:36:14.915484+0000","last_fullsized":"2021-01-27T13:36:14.915484+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929104+0000","last_change":"2021-01-27T13:35:56.833167+0000","last_active":"2021-01-27T13:36:14.929104+0000","last_peered":"2021-01-27T13:36:14.929104+0000","last_clean":"2021-01-27T13:36:14.929104+0000","last_became_active":"2021-01-27T13:35:56.832807+0000","last_became_peered":"2021-01-27T13:35:56.832807+0000","last_unstale":"2021-01-27T13:36:14.929104+0000","last_undegraded":"2021-01-27T13:36:14.929104+0000","last_fullsized":"2021-01-27T13:36:14.929104+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'1","reported_seq":"31","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.926078+0000","last_change":"2021-01-27T13:35:38.193632+0000","last_active":"2021-01-27T13:36:14.926078+0000","last_peered":"2021-01-27T13:36:14.926078+0000","last_clean":"2021-01-27T13:36:14.926078+0000","last_became_active":"2021-01-27T13:35:38.189563+0000","last_became_peered":"2021-01-27T13:35:38.189563+0000","last_unstale":"2021-01-27T13:36:14.926078+0000","last_undegraded":"2021-01-27T13:36:14.926078+0000","last_fullsized":"2021-01-27T13:36:14.926078+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"60'14","reported_seq":"43","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916937+0000","last_change":"2021-01-27T13:35:54.859802+0000","last_active":"2021-01-27T13:36:14.916937+0000","last_peered":"2021-01-27T13:36:14.916937+0000","last_clean":"2021-01-27T13:36:14.916937+0000","last_became_active":"2021-01-27T13:35:54.859101+0000","last_became_peered":"2021-01-27T13:35:54.859101+0000","last_unstale":"2021-01-27T13:36:14.916937+0000","last_undegraded":"2021-01-27T13:36:14.916937+0000","last_fullsized":"2021-01-27T13:36:14.916937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":16,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929046+0000","last_change":"2021-01-27T13:35:59.849304+0000","last_active":"2021-01-27T13:36:14.929046+0000","last_peered":"2021-01-27T13:36:14.929046+0000","last_clean":"2021-01-27T13:36:14.929046+0000","last_became_active":"2021-01-27T13:35:59.848582+0000","last_became_peered":"2021-01-27T13:35:59.848582+0000","last_unstale":"2021-01-27T13:36:14.929046+0000","last_undegraded":"2021-01-27T13:36:14.929046+0000","last_fullsized":"2021-01-27T13:36:14.929046+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924136+0000","last_change":"2021-01-27T13:35:56.830281+0000","last_active":"2021-01-27T13:36:14.924136+0000","last_peered":"2021-01-27T13:36:14.924136+0000","last_clean":"2021-01-27T13:36:14.924136+0000","last_became_active":"2021-01-27T13:35:56.829906+0000","last_became_peered":"2021-01-27T13:35:56.829906+0000","last_unstale":"2021-01-27T13:36:14.924136+0000","last_undegraded":"2021-01-27T13:36:14.924136+0000","last_fullsized":"2021-01-27T13:36:14.924136+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"45'1","reported_seq":"29","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924221+0000","last_change":"2021-01-27T13:35:35.137250+0000","last_active":"2021-01-27T13:36:14.924221+0000","last_peered":"2021-01-27T13:36:14.924221+0000","last_clean":"2021-01-27T13:36:14.924221+0000","last_became_active":"2021-01-27T13:35:35.136787+0000","last_became_peered":"2021-01-27T13:35:35.136787+0000","last_unstale":"2021-01-27T13:36:14.924221+0000","last_undegraded":"2021-01-27T13:36:14.924221+0000","last_fullsized":"2021-01-27T13:36:14.924221+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"60'12","reported_seq":"40","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917035+0000","last_change":"2021-01-27T13:35:54.807718+0000","last_active":"2021-01-27T13:36:14.917035+0000","last_peered":"2021-01-27T13:36:14.917035+0000","last_clean":"2021-01-27T13:36:14.917035+0000","last_became_active":"2021-01-27T13:35:54.807299+0000","last_became_peered":"2021-01-27T13:35:54.807299+0000","last_unstale":"2021-01-27T13:36:14.917035+0000","last_undegraded":"2021-01-27T13:36:14.917035+0000","last_fullsized":"2021-01-27T13:36:14.917035+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915345+0000","last_change":"2021-01-27T13:35:59.864928+0000","last_active":"2021-01-27T13:36:14.915345+0000","last_peered":"2021-01-27T13:36:14.915345+0000","last_clean":"2021-01-27T13:36:14.915345+0000","last_became_active":"2021-01-27T13:35:59.864503+0000","last_became_peered":"2021-01-27T13:35:59.864503+0000","last_unstale":"2021-01-27T13:36:14.915345+0000","last_undegraded":"2021-01-27T13:36:14.915345+0000","last_fullsized":"2021-01-27T13:36:14.915345+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918772+0000","last_change":"2021-01-27T13:35:56.825084+0000","last_active":"2021-01-27T13:36:14.918772+0000","last_peered":"2021-01-27T13:36:14.918772+0000","last_clean":"2021-01-27T13:36:14.918772+0000","last_became_active":"2021-01-27T13:35:56.824101+0000","last_became_peered":"2021-01-27T13:35:56.824101+0000","last_unstale":"2021-01-27T13:36:14.918772+0000","last_undegraded":"2021-01-27T13:36:14.918772+0000","last_fullsized":"2021-01-27T13:36:14.918772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923295+0000","last_change":"2021-01-27T13:35:35.157324+0000","last_active":"2021-01-27T13:36:14.923295+0000","last_peered":"2021-01-27T13:36:14.923295+0000","last_clean":"2021-01-27T13:36:14.923295+0000","last_became_active":"2021-01-27T13:35:35.156664+0000","last_became_peered":"2021-01-27T13:35:35.156664+0000","last_unstale":"2021-01-27T13:36:14.923295+0000","last_undegraded":"2021-01-27T13:36:14.923295+0000","last_fullsized":"2021-01-27T13:36:14.923295+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'15","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921375+0000","last_change":"2021-01-27T13:35:54.803385+0000","last_active":"2021-01-27T13:36:14.921375+0000","last_peered":"2021-01-27T13:36:14.921375+0000","last_clean":"2021-01-27T13:36:14.921375+0000","last_became_active":"2021-01-27T13:35:54.802531+0000","last_became_peered":"2021-01-27T13:35:54.802531+0000","last_unstale":"2021-01-27T13:36:14.921375+0000","last_undegraded":"2021-01-27T13:36:14.921375+0000","last_fullsized":"2021-01-27T13:36:14.921375+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922425+0000","last_change":"2021-01-27T13:35:59.853900+0000","last_active":"2021-01-27T13:36:14.922425+0000","last_peered":"2021-01-27T13:36:14.922425+0000","last_clean":"2021-01-27T13:36:14.922425+0000","last_became_active":"2021-01-27T13:35:59.853492+0000","last_became_peered":"2021-01-27T13:35:59.853492+0000","last_unstale":"2021-01-27T13:36:14.922425+0000","last_undegraded":"2021-01-27T13:36:14.922425+0000","last_fullsized":"2021-01-27T13:36:14.922425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915212+0000","last_change":"2021-01-27T13:35:56.827833+0000","last_active":"2021-01-27T13:36:14.915212+0000","last_peered":"2021-01-27T13:36:14.915212+0000","last_clean":"2021-01-27T13:36:14.915212+0000","last_became_active":"2021-01-27T13:35:56.827414+0000","last_became_peered":"2021-01-27T13:35:56.827414+0000","last_unstale":"2021-01-27T13:36:14.915212+0000","last_undegraded":"2021-01-27T13:36:14.915212+0000","last_fullsized":"2021-01-27T13:36:14.915212+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924947+0000","last_change":"2021-01-27T13:35:35.149635+0000","last_active":"2021-01-27T13:36:14.924947+0000","last_peered":"2021-01-27T13:36:14.924947+0000","last_clean":"2021-01-27T13:36:14.924947+0000","last_became_active":"2021-01-27T13:35:35.149164+0000","last_became_peered":"2021-01-27T13:35:35.149164+0000","last_unstale":"2021-01-27T13:36:14.924947+0000","last_undegraded":"2021-01-27T13:36:14.924947+0000","last_fullsized":"2021-01-27T13:36:14.924947+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'15","reported_seq":"46","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918518+0000","last_change":"2021-01-27T13:35:54.804688+0000","last_active":"2021-01-27T13:36:14.918518+0000","last_peered":"2021-01-27T13:36:14.918518+0000","last_clean":"2021-01-27T13:36:14.918518+0000","last_became_active":"2021-01-27T13:35:54.804383+0000","last_became_peered":"2021-01-27T13:35:54.804383+0000","last_unstale":"2021-01-27T13:36:14.918518+0000","last_undegraded":"2021-01-27T13:36:14.918518+0000","last_fullsized":"2021-01-27T13:36:14.918518+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923380+0000","last_change":"2021-01-27T13:35:59.852509+0000","last_active":"2021-01-27T13:36:14.923380+0000","last_peered":"2021-01-27T13:36:14.923380+0000","last_clean":"2021-01-27T13:36:14.923380+0000","last_became_active":"2021-01-27T13:35:59.852043+0000","last_became_peered":"2021-01-27T13:35:59.852043+0000","last_unstale":"2021-01-27T13:36:14.923380+0000","last_undegraded":"2021-01-27T13:36:14.923380+0000","last_fullsized":"2021-01-27T13:36:14.923380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.947559+0000","last_change":"2021-01-27T13:35:56.834515+0000","last_active":"2021-01-27T13:38:37.947559+0000","last_peered":"2021-01-27T13:38:37.947559+0000","last_clean":"2021-01-27T13:38:37.947559+0000","last_became_active":"2021-01-27T13:35:56.834079+0000","last_became_peered":"2021-01-27T13:35:56.834079+0000","last_unstale":"2021-01-27T13:38:37.947559+0000","last_undegraded":"2021-01-27T13:38:37.947559+0000","last_fullsized":"2021-01-27T13:38:37.947559+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924201+0000","last_change":"2021-01-27T13:35:35.154772+0000","last_active":"2021-01-27T13:36:14.924201+0000","last_peered":"2021-01-27T13:36:14.924201+0000","last_clean":"2021-01-27T13:36:14.924201+0000","last_became_active":"2021-01-27T13:35:35.154354+0000","last_became_peered":"2021-01-27T13:35:35.154354+0000","last_unstale":"2021-01-27T13:36:14.924201+0000","last_undegraded":"2021-01-27T13:36:14.924201+0000","last_fullsized":"2021-01-27T13:36:14.924201+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'13","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924380+0000","last_change":"2021-01-27T13:35:54.861545+0000","last_active":"2021-01-27T13:36:14.924380+0000","last_peered":"2021-01-27T13:36:14.924380+0000","last_clean":"2021-01-27T13:36:14.924380+0000","last_became_active":"2021-01-27T13:35:54.860909+0000","last_became_peered":"2021-01-27T13:35:54.860909+0000","last_unstale":"2021-01-27T13:36:14.924380+0000","last_undegraded":"2021-01-27T13:36:14.924380+0000","last_fullsized":"2021-01-27T13:36:14.924380+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922942+0000","last_change":"2021-01-27T13:35:59.860887+0000","last_active":"2021-01-27T13:36:14.922942+0000","last_peered":"2021-01-27T13:36:14.922942+0000","last_clean":"2021-01-27T13:36:14.922942+0000","last_became_active":"2021-01-27T13:35:59.860501+0000","last_became_peered":"2021-01-27T13:35:59.860501+0000","last_unstale":"2021-01-27T13:36:14.922942+0000","last_undegraded":"2021-01-27T13:36:14.922942+0000","last_fullsized":"2021-01-27T13:36:14.922942+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"55'2","reported_seq":"51","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:32.943332+0000","last_change":"2021-01-27T13:35:56.823320+0000","last_active":"2021-01-27T13:38:32.943332+0000","last_peered":"2021-01-27T13:38:32.943332+0000","last_clean":"2021-01-27T13:38:32.943332+0000","last_became_active":"2021-01-27T13:35:56.822952+0000","last_became_peered":"2021-01-27T13:35:56.822952+0000","last_unstale":"2021-01-27T13:38:32.943332+0000","last_undegraded":"2021-01-27T13:38:32.943332+0000","last_fullsized":"2021-01-27T13:38:32.943332+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"49'4","reported_seq":"50","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923846+0000","last_change":"2021-01-27T13:35:39.306160+0000","last_active":"2021-01-27T13:36:14.923846+0000","last_peered":"2021-01-27T13:36:14.923846+0000","last_clean":"2021-01-27T13:36:14.923846+0000","last_became_active":"2021-01-27T13:35:39.196900+0000","last_became_peered":"2021-01-27T13:35:39.196900+0000","last_unstale":"2021-01-27T13:36:14.923846+0000","last_undegraded":"2021-01-27T13:36:14.923846+0000","last_fullsized":"2021-01-27T13:36:14.923846+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"60'14","reported_seq":"41","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915892+0000","last_change":"2021-01-27T13:35:54.857095+0000","last_active":"2021-01-27T13:36:14.915892+0000","last_peered":"2021-01-27T13:36:14.915892+0000","last_clean":"2021-01-27T13:36:14.915892+0000","last_became_active":"2021-01-27T13:35:54.856231+0000","last_became_peered":"2021-01-27T13:35:54.856231+0000","last_unstale":"2021-01-27T13:36:14.915892+0000","last_undegraded":"2021-01-27T13:36:14.915892+0000","last_fullsized":"2021-01-27T13:36:14.915892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":14,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929805+0000","last_change":"2021-01-27T13:35:59.855833+0000","last_active":"2021-01-27T13:36:14.929805+0000","last_peered":"2021-01-27T13:36:14.929805+0000","last_clean":"2021-01-27T13:36:14.929805+0000","last_became_active":"2021-01-27T13:35:59.855398+0000","last_became_peered":"2021-01-27T13:35:59.855398+0000","last_unstale":"2021-01-27T13:36:14.929805+0000","last_undegraded":"2021-01-27T13:36:14.929805+0000","last_fullsized":"2021-01-27T13:36:14.929805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924105+0000","last_change":"2021-01-27T13:35:56.822952+0000","last_active":"2021-01-27T13:36:14.924105+0000","last_peered":"2021-01-27T13:36:14.924105+0000","last_clean":"2021-01-27T13:36:14.924105+0000","last_became_active":"2021-01-27T13:35:56.822515+0000","last_became_peered":"2021-01-27T13:35:56.822515+0000","last_unstale":"2021-01-27T13:36:14.924105+0000","last_undegraded":"2021-01-27T13:36:14.924105+0000","last_fullsized":"2021-01-27T13:36:14.924105+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"49'1","reported_seq":"28","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924223+0000","last_change":"2021-01-27T13:35:35.160582+0000","last_active":"2021-01-27T13:36:14.924223+0000","last_peered":"2021-01-27T13:36:14.924223+0000","last_clean":"2021-01-27T13:36:14.924223+0000","last_became_active":"2021-01-27T13:35:35.160213+0000","last_became_peered":"2021-01-27T13:35:35.160213+0000","last_unstale":"2021-01-27T13:36:14.924223+0000","last_undegraded":"2021-01-27T13:36:14.924223+0000","last_fullsized":"2021-01-27T13:36:14.924223+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'7","reported_seq":"29","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917533+0000","last_change":"2021-01-27T13:35:54.857148+0000","last_active":"2021-01-27T13:36:14.917533+0000","last_peered":"2021-01-27T13:36:14.917533+0000","last_clean":"2021-01-27T13:36:14.917533+0000","last_became_active":"2021-01-27T13:35:54.856487+0000","last_became_peered":"2021-01-27T13:35:54.856487+0000","last_unstale":"2021-01-27T13:36:14.917533+0000","last_undegraded":"2021-01-27T13:36:14.917533+0000","last_fullsized":"2021-01-27T13:36:14.917533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920576+0000","last_change":"2021-01-27T13:35:59.852428+0000","last_active":"2021-01-27T13:36:14.920576+0000","last_peered":"2021-01-27T13:36:14.920576+0000","last_clean":"2021-01-27T13:36:14.920576+0000","last_became_active":"2021-01-27T13:35:59.848958+0000","last_became_peered":"2021-01-27T13:35:59.848958+0000","last_unstale":"2021-01-27T13:36:14.920576+0000","last_undegraded":"2021-01-27T13:36:14.920576+0000","last_fullsized":"2021-01-27T13:36:14.920576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917861+0000","last_change":"2021-01-27T13:35:56.831305+0000","last_active":"2021-01-27T13:36:14.917861+0000","last_peered":"2021-01-27T13:36:14.917861+0000","last_clean":"2021-01-27T13:36:14.917861+0000","last_became_active":"2021-01-27T13:35:56.830913+0000","last_became_peered":"2021-01-27T13:35:56.830913+0000","last_unstale":"2021-01-27T13:36:14.917861+0000","last_undegraded":"2021-01-27T13:36:14.917861+0000","last_fullsized":"2021-01-27T13:36:14.917861+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916381+0000","last_change":"2021-01-27T13:35:35.148500+0000","last_active":"2021-01-27T13:36:14.916381+0000","last_peered":"2021-01-27T13:36:14.916381+0000","last_clean":"2021-01-27T13:36:14.916381+0000","last_became_active":"2021-01-27T13:35:35.147987+0000","last_became_peered":"2021-01-27T13:35:35.147987+0000","last_unstale":"2021-01-27T13:36:14.916381+0000","last_undegraded":"2021-01-27T13:36:14.916381+0000","last_fullsized":"2021-01-27T13:36:14.916381+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'16","reported_seq":"48","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923121+0000","last_change":"2021-01-27T13:35:54.863498+0000","last_active":"2021-01-27T13:36:14.923121+0000","last_peered":"2021-01-27T13:36:14.923121+0000","last_clean":"2021-01-27T13:36:14.923121+0000","last_became_active":"2021-01-27T13:35:54.862022+0000","last_became_peered":"2021-01-27T13:35:54.862022+0000","last_unstale":"2021-01-27T13:36:14.923121+0000","last_undegraded":"2021-01-27T13:36:14.923121+0000","last_fullsized":"2021-01-27T13:36:14.923121+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":18,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915348+0000","last_change":"2021-01-27T13:35:59.864804+0000","last_active":"2021-01-27T13:36:14.915348+0000","last_peered":"2021-01-27T13:36:14.915348+0000","last_clean":"2021-01-27T13:36:14.915348+0000","last_became_active":"2021-01-27T13:35:59.864371+0000","last_became_peered":"2021-01-27T13:35:59.864371+0000","last_unstale":"2021-01-27T13:36:14.915348+0000","last_undegraded":"2021-01-27T13:36:14.915348+0000","last_fullsized":"2021-01-27T13:36:14.915348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"49'2","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923143+0000","last_change":"2021-01-27T13:35:39.257551+0000","last_active":"2021-01-27T13:36:14.923143+0000","last_peered":"2021-01-27T13:36:14.923143+0000","last_clean":"2021-01-27T13:36:14.923143+0000","last_became_active":"2021-01-27T13:35:39.193102+0000","last_became_peered":"2021-01-27T13:35:39.193102+0000","last_unstale":"2021-01-27T13:36:14.923143+0000","last_undegraded":"2021-01-27T13:36:14.923143+0000","last_fullsized":"2021-01-27T13:36:14.923143+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":247,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"60'15","reported_seq":"74","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:36:16.774047+0000","last_change":"2021-01-27T13:36:16.774047+0000","last_active":"2021-01-27T13:36:16.774047+0000","last_peered":"2021-01-27T13:36:16.774047+0000","last_clean":"2021-01-27T13:36:16.774047+0000","last_became_active":"2021-01-27T13:36:16.030060+0000","last_became_peered":"2021-01-27T13:36:16.030060+0000","last_unstale":"2021-01-27T13:36:16.774047+0000","last_undegraded":"2021-01-27T13:36:16.774047+0000","last_fullsized":"2021-01-27T13:36:16.774047+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":19,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916071+0000","last_change":"2021-01-27T13:35:56.820366+0000","last_active":"2021-01-27T13:36:14.916071+0000","last_peered":"2021-01-27T13:36:14.916071+0000","last_clean":"2021-01-27T13:36:14.916071+0000","last_became_active":"2021-01-27T13:35:56.819472+0000","last_became_peered":"2021-01-27T13:35:56.819472+0000","last_unstale":"2021-01-27T13:36:14.916071+0000","last_undegraded":"2021-01-27T13:36:14.916071+0000","last_fullsized":"2021-01-27T13:36:14.916071+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922419+0000","last_change":"2021-01-27T13:35:59.868626+0000","last_active":"2021-01-27T13:36:14.922419+0000","last_peered":"2021-01-27T13:36:14.922419+0000","last_clean":"2021-01-27T13:36:14.922419+0000","last_became_active":"2021-01-27T13:35:59.868231+0000","last_became_peered":"2021-01-27T13:35:59.868231+0000","last_unstale":"2021-01-27T13:36:14.922419+0000","last_undegraded":"2021-01-27T13:36:14.922419+0000","last_fullsized":"2021-01-27T13:36:14.922419+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923823+0000","last_change":"2021-01-27T13:35:39.190919+0000","last_active":"2021-01-27T13:36:14.923823+0000","last_peered":"2021-01-27T13:36:14.923823+0000","last_clean":"2021-01-27T13:36:14.923823+0000","last_became_active":"2021-01-27T13:35:39.190376+0000","last_became_peered":"2021-01-27T13:35:39.190376+0000","last_unstale":"2021-01-27T13:36:14.923823+0000","last_undegraded":"2021-01-27T13:36:14.923823+0000","last_fullsized":"2021-01-27T13:36:14.923823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'16","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918655+0000","last_change":"2021-01-27T13:35:54.807763+0000","last_active":"2021-01-27T13:36:14.918655+0000","last_peered":"2021-01-27T13:36:14.918655+0000","last_clean":"2021-01-27T13:36:14.918655+0000","last_became_active":"2021-01-27T13:35:54.807014+0000","last_became_peered":"2021-01-27T13:35:54.807014+0000","last_unstale":"2021-01-27T13:36:14.918655+0000","last_undegraded":"2021-01-27T13:36:14.918655+0000","last_fullsized":"2021-01-27T13:36:14.918655+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.946983+0000","last_change":"2021-01-27T13:35:56.821711+0000","last_active":"2021-01-27T13:38:37.946983+0000","last_peered":"2021-01-27T13:38:37.946983+0000","last_clean":"2021-01-27T13:38:37.946983+0000","last_became_active":"2021-01-27T13:35:56.821273+0000","last_became_peered":"2021-01-27T13:35:56.821273+0000","last_unstale":"2021-01-27T13:38:37.946983+0000","last_undegraded":"2021-01-27T13:38:37.946983+0000","last_fullsized":"2021-01-27T13:38:37.946983+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917936+0000","last_change":"2021-01-27T13:35:59.859720+0000","last_active":"2021-01-27T13:36:14.917936+0000","last_peered":"2021-01-27T13:36:14.917936+0000","last_clean":"2021-01-27T13:36:14.917936+0000","last_became_active":"2021-01-27T13:35:59.857343+0000","last_became_peered":"2021-01-27T13:35:59.857343+0000","last_unstale":"2021-01-27T13:36:14.917936+0000","last_undegraded":"2021-01-27T13:36:14.917936+0000","last_fullsized":"2021-01-27T13:36:14.917936+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924020+0000","last_change":"2021-01-27T13:35:35.144264+0000","last_active":"2021-01-27T13:36:14.924020+0000","last_peered":"2021-01-27T13:36:14.924020+0000","last_clean":"2021-01-27T13:36:14.924020+0000","last_became_active":"2021-01-27T13:35:35.143629+0000","last_became_peered":"2021-01-27T13:35:35.143629+0000","last_unstale":"2021-01-27T13:36:14.924020+0000","last_undegraded":"2021-01-27T13:36:14.924020+0000","last_fullsized":"2021-01-27T13:36:14.924020+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"60'25","reported_seq":"65","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923918+0000","last_change":"2021-01-27T13:35:54.810698+0000","last_active":"2021-01-27T13:36:14.923918+0000","last_peered":"2021-01-27T13:36:14.923918+0000","last_clean":"2021-01-27T13:36:14.923918+0000","last_became_active":"2021-01-27T13:35:54.810009+0000","last_became_peered":"2021-01-27T13:35:54.810009+0000","last_unstale":"2021-01-27T13:36:14.923918+0000","last_undegraded":"2021-01-27T13:36:14.923918+0000","last_fullsized":"2021-01-27T13:36:14.923918+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":54,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923529+0000","last_change":"2021-01-27T13:35:56.827498+0000","last_active":"2021-01-27T13:36:14.923529+0000","last_peered":"2021-01-27T13:36:14.923529+0000","last_clean":"2021-01-27T13:36:14.923529+0000","last_became_active":"2021-01-27T13:35:56.827094+0000","last_became_peered":"2021-01-27T13:35:56.827094+0000","last_unstale":"2021-01-27T13:36:14.923529+0000","last_undegraded":"2021-01-27T13:36:14.923529+0000","last_fullsized":"2021-01-27T13:36:14.923529+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929995+0000","last_change":"2021-01-27T13:35:59.860520+0000","last_active":"2021-01-27T13:36:14.929995+0000","last_peered":"2021-01-27T13:36:14.929995+0000","last_clean":"2021-01-27T13:36:14.929995+0000","last_became_active":"2021-01-27T13:35:59.860094+0000","last_became_peered":"2021-01-27T13:35:59.860094+0000","last_unstale":"2021-01-27T13:36:14.929995+0000","last_undegraded":"2021-01-27T13:36:14.929995+0000","last_fullsized":"2021-01-27T13:36:14.929995+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"60'5","reported_seq":"184","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:42.032861+0000","last_change":"2021-01-27T13:35:52.829669+0000","last_active":"2021-01-27T13:38:42.032861+0000","last_peered":"2021-01-27T13:38:42.032861+0000","last_clean":"2021-01-27T13:38:42.032861+0000","last_became_active":"2021-01-27T13:35:52.829069+0000","last_became_peered":"2021-01-27T13:35:52.829069+0000","last_unstale":"2021-01-27T13:38:42.032861+0000","last_undegraded":"2021-01-27T13:38:42.032861+0000","last_fullsized":"2021-01-27T13:38:42.032861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_clean_scrub_stamp":"2021-01-27T13:35:51.730430+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.917213+0000","last_change":"2021-01-27T13:35:35.150496+0000","last_active":"2021-01-27T13:36:14.917213+0000","last_peered":"2021-01-27T13:36:14.917213+0000","last_clean":"2021-01-27T13:36:14.917213+0000","last_became_active":"2021-01-27T13:35:35.149975+0000","last_became_peered":"2021-01-27T13:35:35.149975+0000","last_unstale":"2021-01-27T13:36:14.917213+0000","last_undegraded":"2021-01-27T13:36:14.917213+0000","last_fullsized":"2021-01-27T13:36:14.917213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'15","reported_seq":"49","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921947+0000","last_change":"2021-01-27T13:35:54.803898+0000","last_active":"2021-01-27T13:36:14.921947+0000","last_peered":"2021-01-27T13:36:14.921947+0000","last_clean":"2021-01-27T13:36:14.921947+0000","last_became_active":"2021-01-27T13:35:54.803478+0000","last_became_peered":"2021-01-27T13:35:54.803478+0000","last_unstale":"2021-01-27T13:36:14.921947+0000","last_undegraded":"2021-01-27T13:36:14.921947+0000","last_fullsized":"2021-01-27T13:36:14.921947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922173+0000","last_change":"2021-01-27T13:35:56.816684+0000","last_active":"2021-01-27T13:36:14.922173+0000","last_peered":"2021-01-27T13:36:14.922173+0000","last_clean":"2021-01-27T13:36:14.922173+0000","last_became_active":"2021-01-27T13:35:56.816213+0000","last_became_peered":"2021-01-27T13:35:56.816213+0000","last_unstale":"2021-01-27T13:36:14.922173+0000","last_undegraded":"2021-01-27T13:36:14.922173+0000","last_fullsized":"2021-01-27T13:36:14.922173+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.925216+0000","last_change":"2021-01-27T13:35:59.869293+0000","last_active":"2021-01-27T13:36:14.925216+0000","last_peered":"2021-01-27T13:36:14.925216+0000","last_clean":"2021-01-27T13:36:14.925216+0000","last_became_active":"2021-01-27T13:35:59.868734+0000","last_became_peered":"2021-01-27T13:35:59.868734+0000","last_unstale":"2021-01-27T13:36:14.925216+0000","last_undegraded":"2021-01-27T13:36:14.925216+0000","last_fullsized":"2021-01-27T13:36:14.925216+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"20","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915053+0000","last_change":"2021-01-27T13:35:52.838972+0000","last_active":"2021-01-27T13:36:14.915053+0000","last_peered":"2021-01-27T13:36:14.915053+0000","last_clean":"2021-01-27T13:36:14.915053+0000","last_became_active":"2021-01-27T13:35:52.838094+0000","last_became_peered":"2021-01-27T13:35:52.838094+0000","last_unstale":"2021-01-27T13:36:14.915053+0000","last_undegraded":"2021-01-27T13:36:14.915053+0000","last_fullsized":"2021-01-27T13:36:14.915053+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_clean_scrub_stamp":"2021-01-27T13:35:51.730430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924283+0000","last_change":"2021-01-27T13:35:39.197091+0000","last_active":"2021-01-27T13:36:14.924283+0000","last_peered":"2021-01-27T13:36:14.924283+0000","last_clean":"2021-01-27T13:36:14.924283+0000","last_became_active":"2021-01-27T13:35:39.196542+0000","last_became_peered":"2021-01-27T13:35:39.196542+0000","last_unstale":"2021-01-27T13:36:14.924283+0000","last_undegraded":"2021-01-27T13:36:14.924283+0000","last_fullsized":"2021-01-27T13:36:14.924283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.928967+0000","last_change":"2021-01-27T13:35:39.199903+0000","last_active":"2021-01-27T13:36:14.928967+0000","last_peered":"2021-01-27T13:36:14.928967+0000","last_clean":"2021-01-27T13:36:14.928967+0000","last_became_active":"2021-01-27T13:35:39.199136+0000","last_became_peered":"2021-01-27T13:35:39.199136+0000","last_unstale":"2021-01-27T13:36:14.928967+0000","last_undegraded":"2021-01-27T13:36:14.928967+0000","last_fullsized":"2021-01-27T13:36:14.928967+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:31:07.313411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:31:07.313411+0000","last_clean_scrub_stamp":"2021-01-27T13:31:07.313411+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"60'15","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.925624+0000","last_change":"2021-01-27T13:35:54.862700+0000","last_active":"2021-01-27T13:36:14.925624+0000","last_peered":"2021-01-27T13:36:14.925624+0000","last_clean":"2021-01-27T13:36:14.925624+0000","last_became_active":"2021-01-27T13:35:54.861352+0000","last_became_peered":"2021-01-27T13:35:54.861352+0000","last_unstale":"2021-01-27T13:36:14.925624+0000","last_undegraded":"2021-01-27T13:36:14.925624+0000","last_fullsized":"2021-01-27T13:36:14.925624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929959+0000","last_change":"2021-01-27T13:35:56.825033+0000","last_active":"2021-01-27T13:36:14.929959+0000","last_peered":"2021-01-27T13:36:14.929959+0000","last_clean":"2021-01-27T13:36:14.929959+0000","last_became_active":"2021-01-27T13:35:56.824112+0000","last_became_peered":"2021-01-27T13:35:56.824112+0000","last_unstale":"2021-01-27T13:36:14.929959+0000","last_undegraded":"2021-01-27T13:36:14.929959+0000","last_fullsized":"2021-01-27T13:36:14.929959+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920671+0000","last_change":"2021-01-27T13:35:59.858858+0000","last_active":"2021-01-27T13:36:14.920671+0000","last_peered":"2021-01-27T13:36:14.920671+0000","last_clean":"2021-01-27T13:36:14.920671+0000","last_became_active":"2021-01-27T13:35:59.858189+0000","last_became_peered":"2021-01-27T13:35:59.858189+0000","last_unstale":"2021-01-27T13:36:14.920671+0000","last_undegraded":"2021-01-27T13:36:14.920671+0000","last_fullsized":"2021-01-27T13:36:14.920671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"20","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923279+0000","last_change":"2021-01-27T13:35:52.844207+0000","last_active":"2021-01-27T13:36:14.923279+0000","last_peered":"2021-01-27T13:36:14.923279+0000","last_clean":"2021-01-27T13:36:14.923279+0000","last_became_active":"2021-01-27T13:35:52.843773+0000","last_became_peered":"2021-01-27T13:35:52.843773+0000","last_unstale":"2021-01-27T13:36:14.923279+0000","last_undegraded":"2021-01-27T13:36:14.923279+0000","last_fullsized":"2021-01-27T13:36:14.923279+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:51.730430+0000","last_clean_scrub_stamp":"2021-01-27T13:35:51.730430+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.928837+0000","last_change":"2021-01-27T13:35:39.193131+0000","last_active":"2021-01-27T13:36:14.928837+0000","last_peered":"2021-01-27T13:36:14.928837+0000","last_clean":"2021-01-27T13:36:14.928837+0000","last_became_active":"2021-01-27T13:35:39.190491+0000","last_became_peered":"2021-01-27T13:35:39.190491+0000","last_unstale":"2021-01-27T13:36:14.928837+0000","last_undegraded":"2021-01-27T13:36:14.928837+0000","last_fullsized":"2021-01-27T13:36:14.928837+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'16","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922859+0000","last_change":"2021-01-27T13:35:54.801114+0000","last_active":"2021-01-27T13:36:14.922859+0000","last_peered":"2021-01-27T13:36:14.922859+0000","last_clean":"2021-01-27T13:36:14.922859+0000","last_became_active":"2021-01-27T13:35:54.800642+0000","last_became_peered":"2021-01-27T13:35:54.800642+0000","last_unstale":"2021-01-27T13:36:14.922859+0000","last_undegraded":"2021-01-27T13:36:14.922859+0000","last_fullsized":"2021-01-27T13:36:14.922859+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.926008+0000","last_change":"2021-01-27T13:35:56.824072+0000","last_active":"2021-01-27T13:36:14.926008+0000","last_peered":"2021-01-27T13:36:14.926008+0000","last_clean":"2021-01-27T13:36:14.926008+0000","last_became_active":"2021-01-27T13:35:56.822624+0000","last_became_peered":"2021-01-27T13:35:56.822624+0000","last_unstale":"2021-01-27T13:36:14.926008+0000","last_undegraded":"2021-01-27T13:36:14.926008+0000","last_fullsized":"2021-01-27T13:36:14.926008+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918238+0000","last_change":"2021-01-27T13:35:59.856886+0000","last_active":"2021-01-27T13:36:14.918238+0000","last_peered":"2021-01-27T13:36:14.918238+0000","last_clean":"2021-01-27T13:36:14.918238+0000","last_became_active":"2021-01-27T13:35:59.856375+0000","last_became_peered":"2021-01-27T13:35:59.856375+0000","last_unstale":"2021-01-27T13:36:14.918238+0000","last_undegraded":"2021-01-27T13:36:14.918238+0000","last_fullsized":"2021-01-27T13:36:14.918238+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929965+0000","last_change":"2021-01-27T13:35:39.192523+0000","last_active":"2021-01-27T13:36:14.929965+0000","last_peered":"2021-01-27T13:36:14.929965+0000","last_clean":"2021-01-27T13:36:14.929965+0000","last_became_active":"2021-01-27T13:35:39.191887+0000","last_became_peered":"2021-01-27T13:35:39.191887+0000","last_unstale":"2021-01-27T13:36:14.929965+0000","last_undegraded":"2021-01-27T13:36:14.929965+0000","last_fullsized":"2021-01-27T13:36:14.929965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"60'21","reported_seq":"58","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924685+0000","last_change":"2021-01-27T13:35:54.856005+0000","last_active":"2021-01-27T13:36:14.924685+0000","last_peered":"2021-01-27T13:36:14.924685+0000","last_clean":"2021-01-27T13:36:14.924685+0000","last_became_active":"2021-01-27T13:35:54.855381+0000","last_became_peered":"2021-01-27T13:35:54.855381+0000","last_unstale":"2021-01-27T13:36:14.924685+0000","last_undegraded":"2021-01-27T13:36:14.924685+0000","last_fullsized":"2021-01-27T13:36:14.924685+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924810+0000","last_change":"2021-01-27T13:35:56.822948+0000","last_active":"2021-01-27T13:36:14.924810+0000","last_peered":"2021-01-27T13:36:14.924810+0000","last_clean":"2021-01-27T13:36:14.924810+0000","last_became_active":"2021-01-27T13:35:56.822551+0000","last_became_peered":"2021-01-27T13:35:56.822551+0000","last_unstale":"2021-01-27T13:36:14.924810+0000","last_undegraded":"2021-01-27T13:36:14.924810+0000","last_fullsized":"2021-01-27T13:36:14.924810+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920473+0000","last_change":"2021-01-27T13:35:59.855018+0000","last_active":"2021-01-27T13:36:14.920473+0000","last_peered":"2021-01-27T13:36:14.920473+0000","last_clean":"2021-01-27T13:36:14.920473+0000","last_became_active":"2021-01-27T13:35:59.854452+0000","last_became_peered":"2021-01-27T13:35:59.854452+0000","last_unstale":"2021-01-27T13:36:14.920473+0000","last_undegraded":"2021-01-27T13:36:14.920473+0000","last_fullsized":"2021-01-27T13:36:14.920473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"45'2","reported_seq":"48","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921558+0000","last_change":"2021-01-27T13:35:38.235900+0000","last_active":"2021-01-27T13:36:14.921558+0000","last_peered":"2021-01-27T13:36:14.921558+0000","last_clean":"2021-01-27T13:36:14.921558+0000","last_became_active":"2021-01-27T13:35:38.184773+0000","last_became_peered":"2021-01-27T13:35:38.184773+0000","last_unstale":"2021-01-27T13:36:14.921558+0000","last_undegraded":"2021-01-27T13:36:14.921558+0000","last_fullsized":"2021-01-27T13:36:14.921558+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'22","reported_seq":"58","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.916839+0000","last_change":"2021-01-27T13:35:54.859471+0000","last_active":"2021-01-27T13:36:14.916839+0000","last_peered":"2021-01-27T13:36:14.916839+0000","last_clean":"2021-01-27T13:36:14.916839+0000","last_became_active":"2021-01-27T13:35:54.858612+0000","last_became_peered":"2021-01-27T13:35:54.858612+0000","last_unstale":"2021-01-27T13:36:14.916839+0000","last_undegraded":"2021-01-27T13:36:14.916839+0000","last_fullsized":"2021-01-27T13:36:14.916839+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":26,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.921124+0000","last_change":"2021-01-27T13:35:56.825234+0000","last_active":"2021-01-27T13:36:14.921124+0000","last_peered":"2021-01-27T13:36:14.921124+0000","last_clean":"2021-01-27T13:36:14.921124+0000","last_became_active":"2021-01-27T13:35:56.824788+0000","last_became_peered":"2021-01-27T13:35:56.824788+0000","last_unstale":"2021-01-27T13:36:14.921124+0000","last_undegraded":"2021-01-27T13:36:14.921124+0000","last_fullsized":"2021-01-27T13:36:14.921124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.929934+0000","last_change":"2021-01-27T13:35:59.858877+0000","last_active":"2021-01-27T13:36:14.929934+0000","last_peered":"2021-01-27T13:36:14.929934+0000","last_clean":"2021-01-27T13:36:14.929934+0000","last_became_active":"2021-01-27T13:35:59.858319+0000","last_became_peered":"2021-01-27T13:35:59.858319+0000","last_unstale":"2021-01-27T13:36:14.929934+0000","last_undegraded":"2021-01-27T13:36:14.929934+0000","last_fullsized":"2021-01-27T13:36:14.929934+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.926233+0000","last_change":"2021-01-27T13:35:39.196289+0000","last_active":"2021-01-27T13:36:14.926233+0000","last_peered":"2021-01-27T13:36:14.926233+0000","last_clean":"2021-01-27T13:36:14.926233+0000","last_became_active":"2021-01-27T13:35:39.195825+0000","last_became_peered":"2021-01-27T13:35:39.195825+0000","last_unstale":"2021-01-27T13:36:14.926233+0000","last_undegraded":"2021-01-27T13:36:14.926233+0000","last_fullsized":"2021-01-27T13:36:14.926233+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"60'20","reported_seq":"51","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920170+0000","last_change":"2021-01-27T13:35:54.800827+0000","last_active":"2021-01-27T13:36:14.920170+0000","last_peered":"2021-01-27T13:36:14.920170+0000","last_clean":"2021-01-27T13:36:14.920170+0000","last_became_active":"2021-01-27T13:35:54.800211+0000","last_became_peered":"2021-01-27T13:35:54.800211+0000","last_unstale":"2021-01-27T13:36:14.920170+0000","last_undegraded":"2021-01-27T13:36:14.920170+0000","last_fullsized":"2021-01-27T13:36:14.920170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":39,"num_read_kb":20,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.947164+0000","last_change":"2021-01-27T13:35:56.834796+0000","last_active":"2021-01-27T13:38:37.947164+0000","last_peered":"2021-01-27T13:38:37.947164+0000","last_clean":"2021-01-27T13:38:37.947164+0000","last_became_active":"2021-01-27T13:35:56.834328+0000","last_became_peered":"2021-01-27T13:35:56.834328+0000","last_unstale":"2021-01-27T13:38:37.947164+0000","last_undegraded":"2021-01-27T13:38:37.947164+0000","last_fullsized":"2021-01-27T13:38:37.947164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.915636+0000","last_change":"2021-01-27T13:35:59.861002+0000","last_active":"2021-01-27T13:36:14.915636+0000","last_peered":"2021-01-27T13:36:14.915636+0000","last_clean":"2021-01-27T13:36:14.915636+0000","last_became_active":"2021-01-27T13:35:59.860600+0000","last_became_peered":"2021-01-27T13:35:59.860600+0000","last_unstale":"2021-01-27T13:36:14.915636+0000","last_undegraded":"2021-01-27T13:36:14.915636+0000","last_fullsized":"2021-01-27T13:36:14.915636+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.925029+0000","last_change":"2021-01-27T13:35:56.836901+0000","last_active":"2021-01-27T13:36:14.925029+0000","last_peered":"2021-01-27T13:36:14.925029+0000","last_clean":"2021-01-27T13:36:14.925029+0000","last_became_active":"2021-01-27T13:35:56.835924+0000","last_became_peered":"2021-01-27T13:35:56.835924+0000","last_unstale":"2021-01-27T13:36:14.925029+0000","last_undegraded":"2021-01-27T13:36:14.925029+0000","last_fullsized":"2021-01-27T13:36:14.925029+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"23","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.928953+0000","last_change":"2021-01-27T13:35:39.194125+0000","last_active":"2021-01-27T13:36:14.928953+0000","last_peered":"2021-01-27T13:36:14.928953+0000","last_clean":"2021-01-27T13:36:14.928953+0000","last_became_active":"2021-01-27T13:35:39.193576+0000","last_became_peered":"2021-01-27T13:35:39.193576+0000","last_unstale":"2021-01-27T13:36:14.928953+0000","last_undegraded":"2021-01-27T13:36:14.928953+0000","last_fullsized":"2021-01-27T13:36:14.928953+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"60'15","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.925304+0000","last_change":"2021-01-27T13:35:54.803543+0000","last_active":"2021-01-27T13:36:14.925304+0000","last_peered":"2021-01-27T13:36:14.925304+0000","last_clean":"2021-01-27T13:36:14.925304+0000","last_became_active":"2021-01-27T13:35:54.802882+0000","last_became_peered":"2021-01-27T13:35:54.802882+0000","last_unstale":"2021-01-27T13:36:14.925304+0000","last_undegraded":"2021-01-27T13:36:14.925304+0000","last_fullsized":"2021-01-27T13:36:14.925304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923962+0000","last_change":"2021-01-27T13:35:59.858173+0000","last_active":"2021-01-27T13:36:14.923962+0000","last_peered":"2021-01-27T13:36:14.923962+0000","last_clean":"2021-01-27T13:36:14.923962+0000","last_became_active":"2021-01-27T13:35:59.857791+0000","last_became_peered":"2021-01-27T13:35:59.857791+0000","last_unstale":"2021-01-27T13:36:14.923962+0000","last_undegraded":"2021-01-27T13:36:14.923962+0000","last_fullsized":"2021-01-27T13:36:14.923962+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.947456+0000","last_change":"2021-01-27T13:35:56.827796+0000","last_active":"2021-01-27T13:38:37.947456+0000","last_peered":"2021-01-27T13:38:37.947456+0000","last_clean":"2021-01-27T13:38:37.947456+0000","last_became_active":"2021-01-27T13:35:56.827528+0000","last_became_peered":"2021-01-27T13:35:56.827528+0000","last_unstale":"2021-01-27T13:38:37.947456+0000","last_undegraded":"2021-01-27T13:38:37.947456+0000","last_fullsized":"2021-01-27T13:38:37.947456+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.919252+0000","last_change":"2021-01-27T13:35:39.184759+0000","last_active":"2021-01-27T13:36:14.919252+0000","last_peered":"2021-01-27T13:36:14.919252+0000","last_clean":"2021-01-27T13:36:14.919252+0000","last_became_active":"2021-01-27T13:35:39.184305+0000","last_became_peered":"2021-01-27T13:35:39.184305+0000","last_unstale":"2021-01-27T13:36:14.919252+0000","last_undegraded":"2021-01-27T13:36:14.919252+0000","last_fullsized":"2021-01-27T13:36:14.919252+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'17","reported_seq":"47","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922125+0000","last_change":"2021-01-27T13:35:54.810866+0000","last_active":"2021-01-27T13:36:14.922125+0000","last_peered":"2021-01-27T13:36:14.922125+0000","last_clean":"2021-01-27T13:36:14.922125+0000","last_became_active":"2021-01-27T13:35:54.810468+0000","last_became_peered":"2021-01-27T13:35:54.810468+0000","last_unstale":"2021-01-27T13:36:14.922125+0000","last_undegraded":"2021-01-27T13:36:14.922125+0000","last_fullsized":"2021-01-27T13:36:14.922125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923018+0000","last_change":"2021-01-27T13:35:59.861413+0000","last_active":"2021-01-27T13:36:14.923018+0000","last_peered":"2021-01-27T13:36:14.923018+0000","last_clean":"2021-01-27T13:36:14.923018+0000","last_became_active":"2021-01-27T13:35:59.861044+0000","last_became_peered":"2021-01-27T13:35:59.861044+0000","last_unstale":"2021-01-27T13:36:14.923018+0000","last_undegraded":"2021-01-27T13:36:14.923018+0000","last_fullsized":"2021-01-27T13:36:14.923018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.947036+0000","last_change":"2021-01-27T13:35:56.817833+0000","last_active":"2021-01-27T13:38:37.947036+0000","last_peered":"2021-01-27T13:38:37.947036+0000","last_clean":"2021-01-27T13:38:37.947036+0000","last_became_active":"2021-01-27T13:35:56.816733+0000","last_became_peered":"2021-01-27T13:35:56.816733+0000","last_unstale":"2021-01-27T13:38:37.947036+0000","last_undegraded":"2021-01-27T13:38:37.947036+0000","last_fullsized":"2021-01-27T13:38:37.947036+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918406+0000","last_change":"2021-01-27T13:35:39.190811+0000","last_active":"2021-01-27T13:36:14.918406+0000","last_peered":"2021-01-27T13:36:14.918406+0000","last_clean":"2021-01-27T13:36:14.918406+0000","last_became_active":"2021-01-27T13:35:39.190236+0000","last_became_peered":"2021-01-27T13:35:39.190236+0000","last_unstale":"2021-01-27T13:36:14.918406+0000","last_undegraded":"2021-01-27T13:36:14.918406+0000","last_fullsized":"2021-01-27T13:36:14.918406+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'13","reported_seq":"39","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922021+0000","last_change":"2021-01-27T13:35:54.800684+0000","last_active":"2021-01-27T13:36:14.922021+0000","last_peered":"2021-01-27T13:36:14.922021+0000","last_clean":"2021-01-27T13:36:14.922021+0000","last_became_active":"2021-01-27T13:35:54.800269+0000","last_became_peered":"2021-01-27T13:35:54.800269+0000","last_unstale":"2021-01-27T13:36:14.922021+0000","last_undegraded":"2021-01-27T13:36:14.922021+0000","last_fullsized":"2021-01-27T13:36:14.922021+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922991+0000","last_change":"2021-01-27T13:35:59.867428+0000","last_active":"2021-01-27T13:36:14.922991+0000","last_peered":"2021-01-27T13:36:14.922991+0000","last_clean":"2021-01-27T13:36:14.922991+0000","last_became_active":"2021-01-27T13:35:59.866946+0000","last_became_peered":"2021-01-27T13:35:59.866946+0000","last_unstale":"2021-01-27T13:36:14.922991+0000","last_undegraded":"2021-01-27T13:36:14.922991+0000","last_fullsized":"2021-01-27T13:36:14.922991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920777+0000","last_change":"2021-01-27T13:35:56.829522+0000","last_active":"2021-01-27T13:36:14.920777+0000","last_peered":"2021-01-27T13:36:14.920777+0000","last_clean":"2021-01-27T13:36:14.920777+0000","last_became_active":"2021-01-27T13:35:56.828600+0000","last_became_peered":"2021-01-27T13:35:56.828600+0000","last_unstale":"2021-01-27T13:36:14.920777+0000","last_undegraded":"2021-01-27T13:36:14.920777+0000","last_fullsized":"2021-01-27T13:36:14.920777+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"10","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:36:16.027486+0000","last_change":"2021-01-27T13:36:16.027486+0000","last_active":"2021-01-27T13:36:16.027486+0000","last_peered":"2021-01-27T13:36:16.027486+0000","last_clean":"2021-01-27T13:36:16.027486+0000","last_became_active":"2021-01-27T13:36:16.026813+0000","last_became_peered":"2021-01-27T13:36:16.026813+0000","last_unstale":"2021-01-27T13:36:16.027486+0000","last_undegraded":"2021-01-27T13:36:16.027486+0000","last_fullsized":"2021-01-27T13:36:16.027486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'21","reported_seq":"54","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922668+0000","last_change":"2021-01-27T13:35:54.804557+0000","last_active":"2021-01-27T13:36:14.922668+0000","last_peered":"2021-01-27T13:36:14.922668+0000","last_clean":"2021-01-27T13:36:14.922668+0000","last_became_active":"2021-01-27T13:35:54.803351+0000","last_became_peered":"2021-01-27T13:35:54.803351+0000","last_unstale":"2021-01-27T13:36:14.922668+0000","last_undegraded":"2021-01-27T13:36:14.922668+0000","last_fullsized":"2021-01-27T13:36:14.922668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.928824+0000","last_change":"2021-01-27T13:35:59.869730+0000","last_active":"2021-01-27T13:36:14.928824+0000","last_peered":"2021-01-27T13:36:14.928824+0000","last_clean":"2021-01-27T13:36:14.928824+0000","last_became_active":"2021-01-27T13:35:59.869485+0000","last_became_peered":"2021-01-27T13:35:59.869485+0000","last_unstale":"2021-01-27T13:36:14.928824+0000","last_undegraded":"2021-01-27T13:36:14.928824+0000","last_fullsized":"2021-01-27T13:36:14.928824+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.919963+0000","last_change":"2021-01-27T13:35:56.824095+0000","last_active":"2021-01-27T13:36:14.919963+0000","last_peered":"2021-01-27T13:36:14.919963+0000","last_clean":"2021-01-27T13:36:14.919963+0000","last_became_active":"2021-01-27T13:35:56.823692+0000","last_became_peered":"2021-01-27T13:35:56.823692+0000","last_unstale":"2021-01-27T13:36:14.919963+0000","last_undegraded":"2021-01-27T13:36:14.919963+0000","last_fullsized":"2021-01-27T13:36:14.919963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.920900+0000","last_change":"2021-01-27T13:35:35.148020+0000","last_active":"2021-01-27T13:36:14.920900+0000","last_peered":"2021-01-27T13:36:14.920900+0000","last_clean":"2021-01-27T13:36:14.920900+0000","last_became_active":"2021-01-27T13:35:35.147705+0000","last_became_peered":"2021-01-27T13:35:35.147705+0000","last_unstale":"2021-01-27T13:36:14.920900+0000","last_undegraded":"2021-01-27T13:36:14.920900+0000","last_fullsized":"2021-01-27T13:36:14.920900+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'23","reported_seq":"57","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.924687+0000","last_change":"2021-01-27T13:35:54.859187+0000","last_active":"2021-01-27T13:36:14.924687+0000","last_peered":"2021-01-27T13:36:14.924687+0000","last_clean":"2021-01-27T13:36:14.924687+0000","last_became_active":"2021-01-27T13:35:54.857847+0000","last_became_peered":"2021-01-27T13:35:54.857847+0000","last_unstale":"2021-01-27T13:36:14.924687+0000","last_undegraded":"2021-01-27T13:36:14.924687+0000","last_fullsized":"2021-01-27T13:36:14.924687+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":44,"num_read_kb":25,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.922508+0000","last_change":"2021-01-27T13:35:59.855703+0000","last_active":"2021-01-27T13:36:14.922508+0000","last_peered":"2021-01-27T13:36:14.922508+0000","last_clean":"2021-01-27T13:36:14.922508+0000","last_became_active":"2021-01-27T13:35:59.855224+0000","last_became_peered":"2021-01-27T13:35:59.855224+0000","last_unstale":"2021-01-27T13:36:14.922508+0000","last_undegraded":"2021-01-27T13:36:14.922508+0000","last_fullsized":"2021-01-27T13:36:14.922508+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.918787+0000","last_change":"2021-01-27T13:35:56.831255+0000","last_active":"2021-01-27T13:36:14.918787+0000","last_peered":"2021-01-27T13:36:14.918787+0000","last_clean":"2021-01-27T13:36:14.918787+0000","last_became_active":"2021-01-27T13:35:56.830590+0000","last_became_peered":"2021-01-27T13:35:56.830590+0000","last_unstale":"2021-01-27T13:36:14.918787+0000","last_undegraded":"2021-01-27T13:36:14.918787+0000","last_fullsized":"2021-01-27T13:36:14.918787+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923460+0000","last_change":"2021-01-27T13:35:35.139639+0000","last_active":"2021-01-27T13:36:14.923460+0000","last_peered":"2021-01-27T13:36:14.923460+0000","last_clean":"2021-01-27T13:36:14.923460+0000","last_became_active":"2021-01-27T13:35:35.139211+0000","last_became_peered":"2021-01-27T13:35:35.139211+0000","last_unstale":"2021-01-27T13:36:14.923460+0000","last_undegraded":"2021-01-27T13:36:14.923460+0000","last_fullsized":"2021-01-27T13:36:14.923460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"60'14","reported_seq":"73","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:36:16.362640+0000","last_change":"2021-01-27T13:36:16.362640+0000","last_active":"2021-01-27T13:36:16.362640+0000","last_peered":"2021-01-27T13:36:16.362640+0000","last_clean":"2021-01-27T13:36:16.362640+0000","last_became_active":"2021-01-27T13:36:15.930756+0000","last_became_peered":"2021-01-27T13:36:15.930756+0000","last_unstale":"2021-01-27T13:36:16.362640+0000","last_undegraded":"2021-01-27T13:36:16.362640+0000","last_fullsized":"2021-01-27T13:36:16.362640+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":16,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":894,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923664+0000","last_change":"2021-01-27T13:35:59.862979+0000","last_active":"2021-01-27T13:36:14.923664+0000","last_peered":"2021-01-27T13:36:14.923664+0000","last_clean":"2021-01-27T13:36:14.923664+0000","last_became_active":"2021-01-27T13:35:59.862546+0000","last_became_peered":"2021-01-27T13:35:59.862546+0000","last_unstale":"2021-01-27T13:36:14.923664+0000","last_undegraded":"2021-01-27T13:36:14.923664+0000","last_fullsized":"2021-01-27T13:36:14.923664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:58.810855+0000","last_clean_scrub_stamp":"2021-01-27T13:35:58.810855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"60'2","reported_seq":"73","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.202629+0000","last_change":"2021-01-27T13:35:39.202430+0000","last_active":"2021-01-27T13:38:37.202629+0000","last_peered":"2021-01-27T13:38:37.202629+0000","last_clean":"2021-01-27T13:38:37.202629+0000","last_became_active":"2021-01-27T13:35:39.191559+0000","last_became_peered":"2021-01-27T13:35:39.191559+0000","last_unstale":"2021-01-27T13:38:37.202629+0000","last_undegraded":"2021-01-27T13:38:37.202629+0000","last_fullsized":"2021-01-27T13:38:37.202629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:34.113321+0000","last_clean_scrub_stamp":"2021-01-27T13:35:34.113321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'18","reported_seq":"49","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T13:36:14.923550+0000","last_change":"2021-01-27T13:35:54.860007+0000","last_active":"2021-01-27T13:36:14.923550+0000","last_peered":"2021-01-27T13:36:14.923550+0000","last_clean":"2021-01-27T13:36:14.923550+0000","last_became_active":"2021-01-27T13:35:54.858702+0000","last_became_peered":"2021-01-27T13:35:54.858702+0000","last_unstale":"2021-01-27T13:36:14.923550+0000","last_undegraded":"2021-01-27T13:36:14.923550+0000","last_fullsized":"2021-01-27T13:36:14.923550+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:53.748954+0000","last_clean_scrub_stamp":"2021-01-27T13:35:53.748954+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":20,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-27T13:38:37.947459+0000","last_change":"2021-01-27T13:35:56.830107+0000","last_active":"2021-01-27T13:38:37.947459+0000","last_peered":"2021-01-27T13:38:37.947459+0000","last_clean":"2021-01-27T13:38:37.947459+0000","last_became_active":"2021-01-27T13:35:56.829697+0000","last_became_peered":"2021-01-27T13:35:56.829697+0000","last_unstale":"2021-01-27T13:38:37.947459+0000","last_undegraded":"2021-01-27T13:38:37.947459+0000","last_fullsized":"2021-01-27T13:38:37.947459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T13:35:55.775605+0000","last_clean_scrub_stamp":"2021-01-27T13:35:55.775605+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":1069,"num_read_kb":574,"num_write":542,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":510,"ondisk_log_size":510,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":156,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":514,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430248,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6228,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738924,"statfs":{"total":95995035648,"available":95988658176,"internally_reserved":0,"allocated":864256,"data_stored":294147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:42 2021","interfaces":[{"interface":"back","average":{"1min":2.1850000000000001,"5min":2.2650000000000001,"15min":2.2690000000000001},"min":{"1min":1.413,"5min":1.3320000000000001,"15min":1.3320000000000001},"max":{"1min":3.5019999999999998,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":2.109},{"interface":"front","average":{"1min":2.431,"5min":2.3559999999999999,"15min":2.3769999999999998},"min":{"1min":1.641,"5min":1.371,"15min":1.371},"max":{"1min":3.7480000000000002,"5min":5.3609999999999998,"15min":5.3609999999999998},"last":3.0899999999999999}]},{"osd":1,"last update":"Wed Jan 27 13:38:42 2021","interfaces":[{"interface":"back","average":{"1min":2.7999999999999998,"5min":2.6509999999999998,"15min":2.6299999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":7.2270000000000003,"5min":7.2270000000000003,"15min":7.2270000000000003},"last":7.2270000000000003},{"interface":"front","average":{"1min":3.1219999999999999,"5min":2.7429999999999999,"15min":2.7269999999999999},"min":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"max":{"1min":7.5229999999999997,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":7.5229999999999997}]},{"osd":2,"last update":"Wed Jan 27 13:38:42 2021","interfaces":[{"interface":"back","average":{"1min":3.1469999999999998,"5min":2.8410000000000002,"15min":2.8069999999999999},"min":{"1min":1.5980000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":8.3879999999999999,"5min":8.3879999999999999,"15min":8.3879999999999999},"last":8.3879999999999999},{"interface":"front","average":{"1min":2.597,"5min":2.3919999999999999,"15min":2.3679999999999999},"min":{"1min":1.548,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":4.1429999999999998,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":4.1429999999999998}]},{"osd":3,"last update":"Wed Jan 27 13:38:42 2021","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":2.5190000000000001,"15min":2.5049999999999999},"min":{"1min":1.5720000000000001,"5min":1.52,"15min":1.52},"max":{"1min":4.4980000000000002,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":4.4980000000000002},{"interface":"front","average":{"1min":3.2389999999999999,"5min":3.1320000000000001,"15min":3.1480000000000001},"min":{"1min":2.1419999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"max":{"1min":6.766,"5min":6.766,"15min":6.766},"last":6.766}]},{"osd":4,"last update":"Wed Jan 27 13:38:42 2021","interfaces":[{"interface":"back","average":{"1min":3.5800000000000001,"5min":3.2919999999999998,"15min":3.2919999999999998},"min":{"1min":1.9079999999999999,"5min":1.496,"15min":1.496},"max":{"1min":8.5050000000000008,"5min":8.5050000000000008,"15min":8.5050000000000008},"last":8.5050000000000008},{"interface":"front","average":{"1min":2.9260000000000002,"5min":2.9129999999999998,"15min":2.9460000000000002},"min":{"1min":2.294,"5min":1.47,"15min":1.47},"max":{"1min":4.8769999999999998,"5min":5.3220000000000001,"15min":5.3220000000000001},"last":4.8769999999999998}]},{"osd":5,"last update":"Wed Jan 27 13:38:42 2021","interfaces":[{"interface":"back","average":{"1min":3.5649999999999999,"5min":3.3809999999999998,"15min":3.3929999999999998},"min":{"1min":2.613,"5min":1.4359999999999999,"15min":1.4359999999999999},"max":{"1min":4.6980000000000004,"5min":6.21,"15min":6.21},"last":3.653},{"interface":"front","average":{"1min":4.149,"5min":3.8210000000000002,"15min":3.851},"min":{"1min":2.7250000000000001,"5min":2.093,"15min":2.093},"max":{"1min":8.9550000000000001,"5min":8.9550000000000001,"15min":8.9550000000000001},"last":8.9550000000000001}]},{"osd":6,"last update":"Wed Jan 27 13:38:42 2021","interfaces":[{"interface":"back","average":{"1min":3.8879999999999999,"5min":3.7919999999999998,"15min":3.8439999999999999},"min":{"1min":2.8370000000000002,"5min":1.8979999999999999,"15min":1.8979999999999999},"max":{"1min":7.6029999999999998,"5min":7.6029999999999998,"15min":7.6029999999999998},"last":7.6029999999999998},{"interface":"front","average":{"1min":4.2690000000000001,"5min":3.9809999999999999,"15min":3.9940000000000002},"min":{"1min":2.367,"5min":2.3399999999999999,"15min":2.3399999999999999},"max":{"1min":8.8070000000000004,"5min":8.8070000000000004,"15min":8.8070000000000004},"last":8.8070000000000004}]}]},{"osd":6,"up_from":41,"seq":176093659181,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6344,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738808,"statfs":{"total":95995035648,"available":95988539392,"internally_reserved":0,"allocated":917504,"data_stored":295295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.234,"5min":2.4289999999999998,"15min":2.5569999999999999},"min":{"1min":1.375,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":3.5539999999999998,"5min":10.148,"15min":10.148},"last":2.2789999999999999},{"interface":"front","average":{"1min":2.6800000000000002,"5min":2.7320000000000002,"15min":2.7400000000000002},"min":{"1min":1.444,"5min":1.4219999999999999,"15min":1.4219999999999999},"max":{"1min":4.2530000000000001,"5min":9.7279999999999998,"15min":9.7279999999999998},"last":3.1829999999999998}]},{"osd":1,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":2.2269999999999999,"15min":2.2850000000000001},"min":{"1min":1.3819999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":2.915,"5min":6.6589999999999998,"15min":6.6589999999999998},"last":2.431},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.9510000000000001,"15min":3.0009999999999999},"min":{"1min":1.4630000000000001,"5min":1.2889999999999999,"15min":1.2889999999999999},"max":{"1min":3.7120000000000002,"5min":11.179,"15min":11.179},"last":3.4860000000000002}]},{"osd":2,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":2.4500000000000002,"15min":2.5270000000000001},"min":{"1min":1.5840000000000001,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":2.851,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":1.734},{"interface":"front","average":{"1min":2.3639999999999999,"5min":2.5739999999999998,"15min":2.7080000000000002},"min":{"1min":1.7529999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"max":{"1min":2.923,"5min":11.756,"15min":11.756},"last":1.978}]},{"osd":3,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":3.0150000000000001,"5min":3.2669999999999999,"15min":3.3570000000000002},"min":{"1min":2.1549999999999998,"5min":1.075,"15min":1.075},"max":{"1min":3.879,"5min":10.316000000000001,"15min":10.316000000000001},"last":3.7010000000000001},{"interface":"front","average":{"1min":2.8420000000000001,"5min":2.8650000000000002,"15min":2.931},"min":{"1min":1.8759999999999999,"5min":1.327,"15min":1.327},"max":{"1min":3.3660000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":2.8570000000000002}]},{"osd":4,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":2.7519999999999998,"15min":2.8740000000000001},"min":{"1min":1.4790000000000001,"5min":1.073,"15min":1.073},"max":{"1min":5.9619999999999997,"5min":10.954000000000001,"15min":10.954000000000001},"last":2.508},{"interface":"front","average":{"1min":3.3359999999999999,"5min":3.5470000000000002,"15min":3.6459999999999999},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":4.7110000000000003,"5min":10.603,"15min":10.603},"last":3.8980000000000001}]},{"osd":5,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":2.7549999999999999,"5min":2.9830000000000001,"15min":3.1160000000000001},"min":{"1min":1.28,"5min":1.256,"15min":1.256},"max":{"1min":3.7069999999999999,"5min":10.816000000000001,"15min":10.816000000000001},"last":3.0209999999999999},{"interface":"front","average":{"1min":3.6520000000000001,"5min":3.7690000000000001,"15min":3.8849999999999998},"min":{"1min":1.925,"5min":1.7729999999999999,"15min":1.7729999999999999},"max":{"1min":5.117,"5min":10.849,"15min":10.849},"last":4.1200000000000001}]},{"osd":7,"last update":"Wed Jan 27 13:38:45 2021","interfaces":[{"interface":"back","average":{"1min":4.141,"5min":3.8740000000000001,"15min":3.8799999999999999},"min":{"1min":3.363,"5min":1.706,"15min":1.706},"max":{"1min":5.8259999999999996,"5min":5.8259999999999996,"15min":5.8259999999999996},"last":4.3250000000000002},{"interface":"front","average":{"1min":3.4870000000000001,"5min":3.2610000000000001,"15min":3.2229999999999999},"min":{"1min":2.7250000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"max":{"1min":4.1639999999999997,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":3.29}]}]},{"osd":1,"up_from":16,"seq":68719476809,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6780,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738372,"statfs":{"total":95995035648,"available":95988092928,"internally_reserved":0,"allocated":970752,"data_stored":297377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.8400000000000001,"15min":1.48},"min":{"1min":1.01,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":2.6970000000000001},{"interface":"front","average":{"1min":2.4649999999999999,"5min":2.0129999999999999,"15min":1.5780000000000001},"min":{"1min":1.3859999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":3.7559999999999998,"5min":3.7559999999999998,"15min":3.7559999999999998},"last":1.766}]},{"osd":2,"last update":"Wed Jan 27 13:38:34 2021","interfaces":[{"interface":"back","average":{"1min":2.6030000000000002,"5min":2.3780000000000001,"15min":2.1400000000000001},"min":{"1min":1.6910000000000001,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":2.6440000000000001},{"interface":"front","average":{"1min":2.3119999999999998,"5min":2.1579999999999999,"15min":1.958},"min":{"1min":1.518,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":3.2749999999999999,"5min":3.2749999999999999,"15min":3.2749999999999999},"last":1.9139999999999999}]},{"osd":3,"last update":"Wed Jan 27 13:38:03 2021","interfaces":[{"interface":"back","average":{"1min":2.778,"5min":2.4849999999999999,"15min":2.3370000000000002},"min":{"1min":1.9399999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"max":{"1min":5.3769999999999998,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":2.7669999999999999},{"interface":"front","average":{"1min":3.0289999999999999,"5min":2.6899999999999999,"15min":2.528},"min":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"max":{"1min":5.2069999999999999,"5min":5.2069999999999999,"15min":5.2069999999999999},"last":3.2080000000000002}]},{"osd":4,"last update":"Wed Jan 27 13:38:31 2021","interfaces":[{"interface":"back","average":{"1min":3.573,"5min":3.04,"15min":2.863},"min":{"1min":2.7250000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"max":{"1min":4.7939999999999996,"5min":4.8579999999999997,"15min":4.8579999999999997},"last":2.4159999999999999},{"interface":"front","average":{"1min":3.6949999999999998,"5min":3.1819999999999999,"15min":2.9390000000000001},"min":{"1min":2.2200000000000002,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":5.8470000000000004,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":3.3079999999999998}]},{"osd":5,"last update":"Wed Jan 27 13:37:54 2021","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.1629999999999998,"15min":3.0569999999999999},"min":{"1min":1.754,"5min":1.754,"15min":1.754},"max":{"1min":4.657,"5min":4.657,"15min":4.657},"last":4.0800000000000001},{"interface":"front","average":{"1min":3.419,"5min":3.3759999999999999,"15min":3.3359999999999999},"min":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"max":{"1min":4.4749999999999996,"5min":4.6189999999999998,"15min":4.6189999999999998},"last":3.109}]},{"osd":6,"last update":"Wed Jan 27 13:38:17 2021","interfaces":[{"interface":"back","average":{"1min":3.8540000000000001,"5min":3.6059999999999999,"15min":3.5569999999999999},"min":{"1min":2.6850000000000001,"5min":2.1379999999999999,"15min":2.1379999999999999},"max":{"1min":6.2569999999999997,"5min":6.2569999999999997,"15min":6.2569999999999997},"last":3.8820000000000001},{"interface":"front","average":{"1min":3.8980000000000001,"5min":3.5950000000000002,"15min":3.5129999999999999},"min":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"max":{"1min":5.0659999999999998,"5min":5.0659999999999998,"15min":5.0659999999999998},"last":4.7560000000000002}]},{"osd":7,"last update":"Wed Jan 27 13:38:40 2021","interfaces":[{"interface":"back","average":{"1min":4.1420000000000003,"5min":3.8660000000000001,"15min":3.802},"min":{"1min":3.2250000000000001,"5min":2.5299999999999998,"15min":2.5299999999999998},"max":{"1min":6.6479999999999997,"5min":6.6479999999999997,"15min":6.6479999999999997},"last":4.3319999999999999},{"interface":"front","average":{"1min":4.0910000000000002,"5min":3.9470000000000001,"15min":3.899},"min":{"1min":3.2370000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"max":{"1min":5.0679999999999996,"5min":5.1870000000000003,"15min":5.1870000000000003},"last":4.5129999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673039,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6476,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738676,"statfs":{"total":95995035648,"available":95988404224,"internally_reserved":0,"allocated":856064,"data_stored":293606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.0129999999999999,"5min":1.889,"15min":1.532},"min":{"1min":0.999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.778,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.9339999999999999},{"interface":"front","average":{"1min":2.0190000000000001,"5min":1.853,"15min":1.5529999999999999},"min":{"1min":1.2,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.6930000000000001,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.996}]},{"osd":2,"last update":"Wed Jan 27 13:38:34 2021","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":2.3220000000000001,"15min":2.0590000000000002},"min":{"1min":1.4379999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.6600000000000001,"5min":3.6600000000000001,"15min":3.6600000000000001},"last":2.71},{"interface":"front","average":{"1min":2.383,"5min":2.1419999999999999,"15min":1.9770000000000001},"min":{"1min":1.401,"5min":1.1719999999999999,"15min":1.1719999999999999},"max":{"1min":3.129,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":2.8250000000000002}]},{"osd":3,"last update":"Wed Jan 27 13:38:00 2021","interfaces":[{"interface":"back","average":{"1min":2.3919999999999999,"5min":2.3740000000000001,"15min":2.3100000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.177,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":3.3410000000000002},{"interface":"front","average":{"1min":2.8570000000000002,"5min":2.8069999999999999,"15min":2.722},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":3.1970000000000001}]},{"osd":4,"last update":"Wed Jan 27 13:38:29 2021","interfaces":[{"interface":"back","average":{"1min":2.8849999999999998,"5min":2.585,"15min":2.4910000000000001},"min":{"1min":1.3620000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":3.0579999999999998},{"interface":"front","average":{"1min":3.552,"5min":3.2669999999999999,"15min":3.0630000000000002},"min":{"1min":1.8759999999999999,"5min":1.641,"15min":1.641},"max":{"1min":4.6840000000000002,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":3.4660000000000002}]},{"osd":5,"last update":"Wed Jan 27 13:37:52 2021","interfaces":[{"interface":"back","average":{"1min":2.9900000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"min":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"max":{"1min":3.7320000000000002,"5min":4.516,"15min":4.516},"last":2.5720000000000001},{"interface":"front","average":{"1min":2.9969999999999999,"5min":3.0710000000000002,"15min":3.0710000000000002},"min":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"max":{"1min":4.6680000000000001,"5min":4.6680000000000001,"15min":4.6680000000000001},"last":2.2170000000000001}]},{"osd":6,"last update":"Wed Jan 27 13:38:16 2021","interfaces":[{"interface":"back","average":{"1min":3.6320000000000001,"5min":3.6309999999999998,"15min":3.621},"min":{"1min":1.9630000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"max":{"1min":4.6529999999999996,"5min":5.9500000000000002,"15min":5.9500000000000002},"last":3.9249999999999998},{"interface":"front","average":{"1min":3.2959999999999998,"5min":3.2949999999999999,"15min":3.242},"min":{"1min":1.865,"5min":1.865,"15min":1.865},"max":{"1min":4.3259999999999996,"5min":4.3799999999999999,"15min":4.3799999999999999},"last":3.782}]},{"osd":7,"last update":"Wed Jan 27 13:38:39 2021","interfaces":[{"interface":"back","average":{"1min":4.0739999999999998,"5min":3.9279999999999999,"15min":3.883},"min":{"1min":2.274,"5min":1.9970000000000001,"15min":1.9970000000000001},"max":{"1min":5.8070000000000004,"5min":7.5270000000000001,"15min":7.5270000000000001},"last":3.6880000000000002},{"interface":"front","average":{"1min":4.0039999999999996,"5min":3.7080000000000002,"15min":3.6400000000000001},"min":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"max":{"1min":5.4480000000000004,"5min":6.0759999999999996,"15min":6.0759999999999996},"last":4.1180000000000003}]}]},{"osd":2,"up_from":21,"seq":90194313282,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6308,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738844,"statfs":{"total":95995035648,"available":95988576256,"internally_reserved":0,"allocated":815104,"data_stored":291700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.0070000000000001,"5min":1.964,"15min":1.6799999999999999},"min":{"1min":1.1779999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":3.0470000000000002,"5min":7.1399999999999997,"15min":7.1399999999999997},"last":2.0569999999999999},{"interface":"front","average":{"1min":2.1669999999999998,"5min":2.1619999999999999,"15min":1.8540000000000001},"min":{"1min":1.3540000000000001,"5min":1.204,"15min":1.204},"max":{"1min":2.7440000000000002,"5min":9.5709999999999997,"15min":9.5709999999999997},"last":2.2170000000000001}]},{"osd":1,"last update":"Wed Jan 27 13:38:37 2021","interfaces":[{"interface":"back","average":{"1min":2.1560000000000001,"5min":2.157,"15min":1.9330000000000001},"min":{"1min":1.2390000000000001,"5min":1.105,"15min":1.105},"max":{"1min":2.9670000000000001,"5min":6.585,"15min":6.585},"last":2.1389999999999998},{"interface":"front","average":{"1min":2.5489999999999999,"5min":2.476,"15min":2.1459999999999999},"min":{"1min":1.548,"5min":1.3320000000000001,"15min":1.3320000000000001},"max":{"1min":3.105,"5min":4.157,"15min":4.157},"last":2.589}]},{"osd":3,"last update":"Wed Jan 27 13:38:04 2021","interfaces":[{"interface":"back","average":{"1min":2.7959999999999998,"5min":2.54,"15min":2.3439999999999999},"min":{"1min":2.1840000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":3.5430000000000001,"5min":4.9829999999999997,"15min":4.9829999999999997},"last":2.8759999999999999},{"interface":"front","average":{"1min":2.8239999999999998,"5min":2.7549999999999999,"15min":2.577},"min":{"1min":2.2919999999999998,"5min":1.583,"15min":1.583},"max":{"1min":3.2869999999999999,"5min":7.7409999999999997,"15min":7.7409999999999997},"last":2.9239999999999999}]},{"osd":4,"last update":"Wed Jan 27 13:38:26 2021","interfaces":[{"interface":"back","average":{"1min":2.8420000000000001,"5min":2.863,"15min":2.7589999999999999},"min":{"1min":1.8759999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"max":{"1min":4.3550000000000004,"5min":7.056,"15min":7.056},"last":2.677},{"interface":"front","average":{"1min":3.1960000000000002,"5min":3.161,"15min":3.0059999999999998},"min":{"1min":2.1629999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"max":{"1min":3.8929999999999998,"5min":9.3559999999999999,"15min":9.3559999999999999},"last":3.4670000000000001}]},{"osd":5,"last update":"Wed Jan 27 13:37:54 2021","interfaces":[{"interface":"back","average":{"1min":3.8399999999999999,"5min":3.4870000000000001,"15min":3.3340000000000001},"min":{"1min":3.1890000000000001,"5min":1.923,"15min":1.923},"max":{"1min":4.8929999999999998,"5min":8.4250000000000007,"15min":8.4250000000000007},"last":4.2149999999999999},{"interface":"front","average":{"1min":3.3330000000000002,"5min":3.2839999999999998,"15min":3.246},"min":{"1min":2.6960000000000002,"5min":2.048,"15min":2.048},"max":{"1min":3.9710000000000001,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":3.3740000000000001}]},{"osd":6,"last update":"Wed Jan 27 13:38:17 2021","interfaces":[{"interface":"back","average":{"1min":3.5910000000000002,"5min":3.71,"15min":3.762},"min":{"1min":2.3730000000000002,"5min":1.744,"15min":1.744},"max":{"1min":4.6959999999999997,"5min":5.1870000000000003,"15min":5.1870000000000003},"last":3.6000000000000001},{"interface":"front","average":{"1min":3.6190000000000002,"5min":3.7090000000000001,"15min":3.7610000000000001},"min":{"1min":2.5179999999999998,"5min":2.2949999999999999,"15min":2.2949999999999999},"max":{"1min":5.0490000000000004,"5min":7.2699999999999996,"15min":7.2699999999999996},"last":4.1369999999999996}]},{"osd":7,"last update":"Wed Jan 27 13:38:40 2021","interfaces":[{"interface":"back","average":{"1min":3.7290000000000001,"5min":3.9399999999999999,"15min":4.0380000000000003},"min":{"1min":2.3929999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"max":{"1min":4.9729999999999999,"5min":6.5049999999999999,"15min":6.5049999999999999},"last":3.8730000000000002},{"interface":"front","average":{"1min":3.9670000000000001,"5min":4.2199999999999998,"15min":4.3259999999999996},"min":{"1min":2.6589999999999998,"5min":2.3700000000000001,"15min":2.3700000000000001},"max":{"1min":5.1210000000000004,"5min":9.1609999999999996,"15min":9.1609999999999996},"last":3.923}]}]},{"osd":3,"up_from":26,"seq":111669149757,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6584,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738568,"statfs":{"total":95995035648,"available":95988293632,"internally_reserved":0,"allocated":966656,"data_stored":297150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":1.9159999999999999,"15min":1.724},"min":{"1min":1.014,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":3.0289999999999999,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.052},{"interface":"front","average":{"1min":2.1379999999999999,"5min":2.1030000000000002,"15min":2.0750000000000002},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":3.2450000000000001,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":2.125}]},{"osd":1,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.4990000000000001,"5min":2.3010000000000002,"15min":2.1520000000000001},"min":{"1min":1.353,"5min":1.214,"15min":1.214},"max":{"1min":3.3599999999999999,"5min":4.7670000000000003,"15min":4.7670000000000003},"last":3.069},{"interface":"front","average":{"1min":2.3679999999999999,"5min":2.2730000000000001,"15min":2.2250000000000001},"min":{"1min":1.952,"5min":1.133,"15min":1.133},"max":{"1min":3.1760000000000002,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":2.2490000000000001}]},{"osd":2,"last update":"Wed Jan 27 13:38:07 2021","interfaces":[{"interface":"back","average":{"1min":2.3919999999999999,"5min":2.3370000000000002,"15min":2.3490000000000002},"min":{"1min":1.6080000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.6280000000000001,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":2.7959999999999998},{"interface":"front","average":{"1min":2.8599999999999999,"5min":2.6579999999999999,"15min":2.4740000000000002},"min":{"1min":2.1349999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"max":{"1min":3.722,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":3.1859999999999999}]},{"osd":4,"last update":"Wed Jan 27 13:38:23 2021","interfaces":[{"interface":"back","average":{"1min":3.4830000000000001,"5min":3.0920000000000001,"15min":2.79},"min":{"1min":2.2770000000000001,"5min":1.359,"15min":1.359},"max":{"1min":5.8440000000000003,"5min":5.8440000000000003,"15min":5.8440000000000003},"last":3.4870000000000001},{"interface":"front","average":{"1min":3.3660000000000001,"5min":3.129,"15min":2.9329999999999998},"min":{"1min":2.1440000000000001,"5min":1.651,"15min":1.651},"max":{"1min":4.7030000000000003,"5min":4.9870000000000001,"15min":4.9870000000000001},"last":3.536}]},{"osd":5,"last update":"Wed Jan 27 13:37:51 2021","interfaces":[{"interface":"back","average":{"1min":3.4630000000000001,"5min":3.3260000000000001,"15min":3.2999999999999998},"min":{"1min":2.5289999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"max":{"1min":4.4370000000000003,"5min":5.0720000000000001,"15min":5.0720000000000001},"last":4.1079999999999997},{"interface":"front","average":{"1min":3.6880000000000002,"5min":3.3929999999999998,"15min":3.3010000000000002},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":4.984,"5min":4.984,"15min":4.984},"last":4.3019999999999996}]},{"osd":6,"last update":"Wed Jan 27 13:38:19 2021","interfaces":[{"interface":"back","average":{"1min":3.714,"5min":3.7000000000000002,"15min":3.698},"min":{"1min":2.2120000000000002,"5min":1.8049999999999999,"15min":1.8049999999999999},"max":{"1min":4.79,"5min":5.4279999999999999,"15min":5.4279999999999999},"last":4.4960000000000004},{"interface":"front","average":{"1min":3.3439999999999999,"5min":3.2309999999999999,"15min":3.2069999999999999},"min":{"1min":2.0819999999999999,"5min":1.867,"15min":1.867},"max":{"1min":4.2480000000000002,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":3.835}]},{"osd":7,"last update":"Wed Jan 27 13:38:43 2021","interfaces":[{"interface":"back","average":{"1min":3.8860000000000001,"5min":3.7189999999999999,"15min":3.669},"min":{"1min":2.879,"5min":2.1720000000000002,"15min":2.1720000000000002},"max":{"1min":5.5990000000000002,"5min":5.5990000000000002,"15min":5.5990000000000002},"last":4.0709999999999997},{"interface":"front","average":{"1min":4.0890000000000004,"5min":3.919,"15min":3.923},"min":{"1min":2.6150000000000002,"5min":2.024,"15min":2.024},"max":{"1min":6.4729999999999999,"5min":6.4729999999999999,"15min":6.4729999999999999},"last":4.9349999999999996}]}]},{"osd":4,"up_from":31,"seq":133143986232,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6484,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738668,"statfs":{"total":95995035648,"available":95988396032,"internally_reserved":0,"allocated":929792,"data_stored":296271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:38:24 2021","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.0249999999999999,"15min":1.8839999999999999},"min":{"1min":1.2789999999999999,"5min":1.228,"15min":1.228},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":2.198},{"interface":"front","average":{"1min":2.2210000000000001,"5min":2.077,"15min":1.925},"min":{"1min":1.321,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":4.8719999999999999,"5min":6.8949999999999996,"15min":6.8949999999999996},"last":2.278}]},{"osd":1,"last update":"Wed Jan 27 13:38:24 2021","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":2.0840000000000001,"15min":1.9450000000000001},"min":{"1min":1.6060000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"max":{"1min":2.5350000000000001,"5min":9.1980000000000004,"15min":9.1980000000000004},"last":2.3900000000000001},{"interface":"front","average":{"1min":2.7130000000000001,"5min":2.4260000000000002,"15min":2.2330000000000001},"min":{"1min":1.3859999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"max":{"1min":5.6050000000000004,"5min":5.6050000000000004,"15min":5.6050000000000004},"last":2.8530000000000002}]},{"osd":2,"last update":"Wed Jan 27 13:38:24 2021","interfaces":[{"interface":"back","average":{"1min":2.911,"5min":2.488,"15min":2.262},"min":{"1min":1.6140000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"max":{"1min":5.3739999999999997,"5min":5.8029999999999999,"15min":5.8029999999999999},"last":3.3780000000000001},{"interface":"front","average":{"1min":2.7719999999999998,"5min":2.6659999999999999,"15min":2.5089999999999999},"min":{"1min":1.8759999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"max":{"1min":5.3220000000000001,"5min":6.5179999999999998,"15min":6.5179999999999998},"last":3.036}]},{"osd":3,"last update":"Wed Jan 27 13:38:24 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":2.7130000000000001,"15min":2.5190000000000001},"min":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":4.4320000000000004,"5min":6.7149999999999999,"15min":6.7149999999999999},"last":3.472},{"interface":"front","average":{"1min":2.7370000000000001,"5min":2.552,"15min":2.3620000000000001},"min":{"1min":1.798,"5min":1.74,"15min":1.74},"max":{"1min":3.9279999999999999,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":3.5219999999999998}]},{"osd":5,"last update":"Wed Jan 27 13:37:52 2021","interfaces":[{"interface":"back","average":{"1min":3.0680000000000001,"5min":2.5979999999999999,"15min":2.4980000000000002},"min":{"1min":1.5660000000000001,"5min":1.355,"15min":1.355},"max":{"1min":7.9749999999999996,"5min":7.9749999999999996,"15min":7.9749999999999996},"last":3.698},{"interface":"front","average":{"1min":3.0979999999999999,"5min":2.7679999999999998,"15min":2.7269999999999999},"min":{"1min":1.409,"5min":1.409,"15min":1.409},"max":{"1min":5.6239999999999997,"5min":5.6239999999999997,"15min":5.6239999999999997},"last":3.9849999999999999}]},{"osd":6,"last update":"Wed Jan 27 13:38:18 2021","interfaces":[{"interface":"back","average":{"1min":3.456,"5min":3.2109999999999999,"15min":3.1850000000000001},"min":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":5.9610000000000003,"5min":5.9610000000000003,"15min":5.9610000000000003},"last":3.8340000000000001},{"interface":"front","average":{"1min":3.5979999999999999,"5min":3.4500000000000002,"15min":3.4460000000000002},"min":{"1min":1.347,"5min":1.347,"15min":1.347},"max":{"1min":5.7880000000000003,"5min":7.077,"15min":7.077},"last":3.919}]},{"osd":7,"last update":"Wed Jan 27 13:38:40 2021","interfaces":[{"interface":"back","average":{"1min":3.4790000000000001,"5min":3.3239999999999998,"15min":3.2650000000000001},"min":{"1min":1.4219999999999999,"5min":1.389,"15min":1.389},"max":{"1min":4.5549999999999997,"5min":6.569,"15min":6.569},"last":4.2809999999999997},{"interface":"front","average":{"1min":3.7469999999999999,"5min":3.508,"15min":3.4500000000000002},"min":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"max":{"1min":6.0780000000000003,"5min":6.6029999999999998,"15min":6.6029999999999998},"last":4.1689999999999996}]}]},{"osd":5,"up_from":36,"seq":154618822707,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6248,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738904,"statfs":{"total":95995035648,"available":95988637696,"internally_reserved":0,"allocated":819200,"data_stored":291668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.2149999999999999,"5min":1.958,"15min":1.8959999999999999},"min":{"1min":1.522,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":3.4449999999999998,"5min":3.75,"15min":3.75},"last":1.9910000000000001},{"interface":"front","average":{"1min":2.3570000000000002,"5min":2.0630000000000002,"15min":2.0169999999999999},"min":{"1min":1.5449999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":3.8980000000000001,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":4.133}]},{"osd":1,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.2999999999999998,"5min":2.1019999999999999,"15min":2.0249999999999999},"min":{"1min":1.6779999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.6779999999999999,"5min":3.6779999999999999,"15min":3.6779999999999999},"last":2.1269999999999998},{"interface":"front","average":{"1min":2.46,"5min":2.6349999999999998,"15min":2.6850000000000001},"min":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"max":{"1min":3.8370000000000002,"5min":9.8770000000000007,"15min":9.8770000000000007},"last":2.0720000000000001}]},{"osd":2,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":2.2589999999999999,"15min":2.117},"min":{"1min":1.903,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":4.96},{"interface":"front","average":{"1min":2.7130000000000001,"5min":2.395,"15min":2.2669999999999999},"min":{"1min":1.734,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":3.6629999999999998,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":4.4720000000000004}]},{"osd":3,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":2.6179999999999999,"15min":2.5049999999999999},"min":{"1min":2.0059999999999998,"5min":1.298,"15min":1.298},"max":{"1min":3.9159999999999999,"5min":4.2290000000000001,"15min":4.2290000000000001},"last":2.6899999999999999},{"interface":"front","average":{"1min":2.9409999999999998,"5min":2.6429999999999998,"15min":2.4769999999999999},"min":{"1min":1.6699999999999999,"5min":1.605,"15min":1.605},"max":{"1min":4.0759999999999996,"5min":4.4039999999999999,"15min":4.4039999999999999},"last":3.3769999999999998}]},{"osd":4,"last update":"Wed Jan 27 13:37:50 2021","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":2.5089999999999999,"15min":2.3799999999999999},"min":{"1min":1.2729999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":5.1269999999999998,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":4.5640000000000001},{"interface":"front","average":{"1min":3.3170000000000002,"5min":2.782,"15min":2.5920000000000001},"min":{"1min":1.7509999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":4.8940000000000001,"5min":4.8959999999999999,"15min":4.8959999999999999},"last":3.2109999999999999}]},{"osd":6,"last update":"Wed Jan 27 13:38:15 2021","interfaces":[{"interface":"back","average":{"1min":3.4169999999999998,"5min":3.1459999999999999,"15min":3.0369999999999999},"min":{"1min":1.889,"5min":1.107,"15min":1.107},"max":{"1min":4.492,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":5.0609999999999999},{"interface":"front","average":{"1min":3.6520000000000001,"5min":3.3610000000000002,"15min":3.2400000000000002},"min":{"1min":2.8570000000000002,"5min":1.591,"15min":1.591},"max":{"1min":4.835,"5min":5.2199999999999998,"15min":5.2199999999999998},"last":3.8530000000000002}]},{"osd":7,"last update":"Wed Jan 27 13:37:42 2021","interfaces":[{"interface":"back","average":{"1min":3.3159999999999998,"5min":3.2829999999999999,"15min":3.2770000000000001},"min":{"1min":1.833,"5min":1.5029999999999999,"15min":1.5029999999999999},"max":{"1min":4.1580000000000004,"5min":4.8230000000000004,"15min":4.8230000000000004},"last":4.0350000000000001},{"interface":"front","average":{"1min":3.605,"5min":3.5099999999999998,"15min":3.4940000000000002},"min":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":5.8410000000000002}]}]}]}} 2021-01-27T13:38:47.340 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-01-27T13:38:47.340 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-01-27T13:38:47.341 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-01-27T13:38:47.341 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid 8e2eaa02-60a3-11eb-8f9a-001a4aab830c -- ceph health --format=json 2021-01-27T13:38:47.499 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/8e2eaa02-60a3-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T13:38:47.808 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:38:47 smithi037 bash[9955]: debug 2021-01-27T13:38:47.793+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:38:48.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:47 smithi099 bash[9889]: cluster 2021-01-27T13:38:46.224403+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:48.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:47 smithi099 bash[9889]: audit 2021-01-27T13:38:46.494116+0000 mgr.y (mgr.14138) 437 : audit [DBG] from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T13:38:48.062 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:38:47 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:38:48.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:47 smithi037 bash[13442]: cluster 2021-01-27T13:38:46.224403+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:48.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:47 smithi037 bash[13442]: audit 2021-01-27T13:38:46.494116+0000 mgr.y (mgr.14138) 437 : audit [DBG] from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T13:38:48.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:47 smithi037 bash[9724]: cluster 2021-01-27T13:38:46.224403+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:48.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:47 smithi037 bash[9724]: audit 2021-01-27T13:38:46.494116+0000 mgr.y (mgr.14138) 437 : audit [DBG] from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T13:38:49.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:48 smithi037 bash[9724]: audit 2021-01-27T13:38:47.801332+0000 mgr.y (mgr.14138) 438 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:49.004 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:48 smithi037 bash[13442]: audit 2021-01-27T13:38:47.801332+0000 mgr.y (mgr.14138) 438 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:49.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:48 smithi099 bash[9889]: audit 2021-01-27T13:38:47.801332+0000 mgr.y (mgr.14138) 438 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:50.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:49 smithi037 bash[9724]: cluster 2021-01-27T13:38:48.225347+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:50.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:49 smithi037 bash[13442]: cluster 2021-01-27T13:38:48.225347+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:50.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:49 smithi099 bash[9889]: cluster 2021-01-27T13:38:48.225347+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:50.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2021-01-27T13:38:51.779 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-01-27T13:38:51.780 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-01-27T13:38:51.780 INFO:tasks.cephadm:Setup complete, yielding 2021-01-27T13:38:51.781 INFO:teuthology.run_tasks:Running task workunit... 2021-01-27T13:38:51.793 INFO:tasks.workunit:Pulling workunits from ref 507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:38:51.795 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-01-27T13:38:51.796 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2021-01-27T13:38:51.804 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-27T13:38:51.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T13:38:51.804 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-01-27T13:38:51.812 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-01-27T13:38:51.812 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-01-27T13:38:51.863 INFO:tasks.workunit:timeout=3h 2021-01-27T13:38:51.864 INFO:tasks.workunit:cleanup=True 2021-01-27T13:38:51.864 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 507028cb839c25d6666833702df6325fd8569096 2021-01-27T13:38:51.873 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-01-27T13:38:52.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:51 smithi037 bash[9724]: cluster 2021-01-27T13:38:50.226409+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:52.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:51 smithi037 bash[9724]: audit 2021-01-27T13:38:50.955610+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.37:0/2060306063' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T13:38:52.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:51 smithi037 bash[13442]: cluster 2021-01-27T13:38:50.226409+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:52.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:51 smithi037 bash[13442]: audit 2021-01-27T13:38:50.955610+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.37:0/2060306063' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T13:38:52.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:51 smithi099 bash[9889]: cluster 2021-01-27T13:38:50.226409+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:52.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:51 smithi099 bash[9889]: audit 2021-01-27T13:38:50.955610+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.37:0/2060306063' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T13:38:54.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:53 smithi099 bash[9889]: cluster 2021-01-27T13:38:52.227599+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:54.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:53 smithi037 bash[9724]: cluster 2021-01-27T13:38:52.227599+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:54.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:53 smithi037 bash[13442]: cluster 2021-01-27T13:38:52.227599+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:56.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:55 smithi099 bash[9889]: cluster 2021-01-27T13:38:54.228740+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:56.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:55 smithi037 bash[9724]: cluster 2021-01-27T13:38:54.228740+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:56.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:55 smithi037 bash[13442]: cluster 2021-01-27T13:38:54.228740+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:38:58.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:57 smithi037 bash[9724]: cluster 2021-01-27T13:38:56.229844+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:58.073 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:38:57 smithi037 bash[9955]: debug 2021-01-27T13:38:57.809+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:38:58.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:57 smithi037 bash[13442]: cluster 2021-01-27T13:38:56.229844+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:58.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:57 smithi099 bash[9889]: cluster 2021-01-27T13:38:56.229844+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:38:58.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:38:57 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:38:59.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:58 smithi099 bash[9889]: audit 2021-01-27T13:38:57.812727+0000 mgr.y (mgr.14138) 444 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:59.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:58 smithi037 bash[9724]: audit 2021-01-27T13:38:57.812727+0000 mgr.y (mgr.14138) 444 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:38:59.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:58 smithi037 bash[13442]: audit 2021-01-27T13:38:57.812727+0000 mgr.y (mgr.14138) 444 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:00.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:38:59 smithi099 bash[9889]: cluster 2021-01-27T13:38:58.230806+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:00.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:38:59 smithi037 bash[9724]: cluster 2021-01-27T13:38:58.230806+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:00.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:38:59 smithi037 bash[13442]: cluster 2021-01-27T13:38:58.230806+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:02.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:01 smithi099 bash[9889]: cluster 2021-01-27T13:39:00.232000+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:02.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:01 smithi037 bash[9724]: cluster 2021-01-27T13:39:00.232000+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:02.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:01 smithi037 bash[13442]: cluster 2021-01-27T13:39:00.232000+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:04.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:03 smithi099 bash[9889]: cluster 2021-01-27T13:39:02.233100+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:04.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:03 smithi037 bash[9724]: cluster 2021-01-27T13:39:02.233100+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:04.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:03 smithi037 bash[13442]: cluster 2021-01-27T13:39:02.233100+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:06.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:05 smithi099 bash[9889]: cluster 2021-01-27T13:39:04.234304+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:06.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:05 smithi037 bash[9724]: cluster 2021-01-27T13:39:04.234304+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:06.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:05 smithi037 bash[13442]: cluster 2021-01-27T13:39:04.234304+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:08.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:07 smithi099 bash[9889]: cluster 2021-01-27T13:39:06.235409+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:08.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:39:07 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:39:08.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:07 smithi037 bash[9724]: cluster 2021-01-27T13:39:06.235409+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:08.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:39:07 smithi037 bash[9955]: debug 2021-01-27T13:39:07.821+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:39:08.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:07 smithi037 bash[13442]: cluster 2021-01-27T13:39:06.235409+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:09.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:08 smithi099 bash[9889]: audit 2021-01-27T13:39:07.823892+0000 mgr.y (mgr.14138) 450 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:09.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:08 smithi037 bash[9724]: audit 2021-01-27T13:39:07.823892+0000 mgr.y (mgr.14138) 450 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:09.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:08 smithi037 bash[13442]: audit 2021-01-27T13:39:07.823892+0000 mgr.y (mgr.14138) 450 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:10.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:09 smithi099 bash[9889]: cluster 2021-01-27T13:39:08.236468+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:10.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:09 smithi037 bash[9724]: cluster 2021-01-27T13:39:08.236468+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:10.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:09 smithi037 bash[13442]: cluster 2021-01-27T13:39:08.236468+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:12.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:11 smithi099 bash[9889]: cluster 2021-01-27T13:39:10.237512+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:12.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:11 smithi037 bash[9724]: cluster 2021-01-27T13:39:10.237512+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:12.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:11 smithi037 bash[13442]: cluster 2021-01-27T13:39:10.237512+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:14.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:13 smithi099 bash[9889]: cluster 2021-01-27T13:39:12.238524+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:14.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:13 smithi037 bash[9724]: cluster 2021-01-27T13:39:12.238524+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:14.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:13 smithi037 bash[13442]: cluster 2021-01-27T13:39:12.238524+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:15.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:14 smithi099 bash[9889]: audit 2021-01-27T13:39:14.293595+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:39:15.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:14 smithi099 bash[9889]: audit 2021-01-27T13:39:14.294369+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:39:15.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:14 smithi037 bash[9724]: audit 2021-01-27T13:39:14.293595+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:39:15.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:14 smithi037 bash[9724]: audit 2021-01-27T13:39:14.294369+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:39:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:14 smithi037 bash[13442]: audit 2021-01-27T13:39:14.293595+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:39:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:14 smithi037 bash[13442]: audit 2021-01-27T13:39:14.294369+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:39:16.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:15 smithi099 bash[9889]: cluster 2021-01-27T13:39:14.239671+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:16.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:15 smithi037 bash[9724]: cluster 2021-01-27T13:39:14.239671+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:16.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:15 smithi037 bash[13442]: cluster 2021-01-27T13:39:14.239671+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:18.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:17 smithi099 bash[9889]: cluster 2021-01-27T13:39:16.240745+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:18.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:39:17 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:39:18.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:17 smithi037 bash[9724]: cluster 2021-01-27T13:39:16.240745+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:18.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:39:17 smithi037 bash[9955]: debug 2021-01-27T13:39:17.833+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:39:18.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:17 smithi037 bash[13442]: cluster 2021-01-27T13:39:16.240745+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:19.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:18 smithi099 bash[9889]: audit 2021-01-27T13:39:17.835256+0000 mgr.y (mgr.14138) 456 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:19.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:18 smithi037 bash[9724]: audit 2021-01-27T13:39:17.835256+0000 mgr.y (mgr.14138) 456 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:19.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:18 smithi037 bash[13442]: audit 2021-01-27T13:39:17.835256+0000 mgr.y (mgr.14138) 456 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:20.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:19 smithi099 bash[9889]: cluster 2021-01-27T13:39:18.241822+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:20.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:19 smithi037 bash[9724]: cluster 2021-01-27T13:39:18.241822+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:20.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:19 smithi037 bash[13442]: cluster 2021-01-27T13:39:18.241822+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:22.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:21 smithi099 bash[9889]: cluster 2021-01-27T13:39:20.242867+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:22.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:21 smithi037 bash[9724]: cluster 2021-01-27T13:39:20.242867+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:22.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:21 smithi037 bash[13442]: cluster 2021-01-27T13:39:20.242867+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:24.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:23 smithi099 bash[9889]: cluster 2021-01-27T13:39:22.243948+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:24.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:23 smithi037 bash[9724]: cluster 2021-01-27T13:39:22.243948+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:24.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:23 smithi037 bash[13442]: cluster 2021-01-27T13:39:22.243948+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:26.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:25 smithi099 bash[9889]: cluster 2021-01-27T13:39:24.245178+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:26.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:25 smithi037 bash[9724]: cluster 2021-01-27T13:39:24.245178+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:26.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:25 smithi037 bash[13442]: cluster 2021-01-27T13:39:24.245178+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:28.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:27 smithi099 bash[9889]: cluster 2021-01-27T13:39:26.246431+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:28.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:39:27 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:39:28.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:27 smithi037 bash[9724]: cluster 2021-01-27T13:39:26.246431+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:28.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:27 smithi037 bash[13442]: cluster 2021-01-27T13:39:26.246431+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:28.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:39:27 smithi037 bash[9955]: debug 2021-01-27T13:39:27.845+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:39:29.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:28 smithi099 bash[9889]: audit 2021-01-27T13:39:27.846569+0000 mgr.y (mgr.14138) 462 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:29.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:28 smithi037 bash[9724]: audit 2021-01-27T13:39:27.846569+0000 mgr.y (mgr.14138) 462 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:29.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:28 smithi037 bash[13442]: audit 2021-01-27T13:39:27.846569+0000 mgr.y (mgr.14138) 462 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:30.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:29 smithi099 bash[9889]: cluster 2021-01-27T13:39:28.247512+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:30.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:29 smithi037 bash[9724]: cluster 2021-01-27T13:39:28.247512+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:30.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:29 smithi037 bash[13442]: cluster 2021-01-27T13:39:28.247512+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:32.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:31 smithi099 bash[9889]: cluster 2021-01-27T13:39:30.248496+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:31 smithi037 bash[9724]: cluster 2021-01-27T13:39:30.248496+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:32.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:31 smithi037 bash[13442]: cluster 2021-01-27T13:39:30.248496+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:34.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:33 smithi099 bash[9889]: cluster 2021-01-27T13:39:32.249661+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:34.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:33 smithi037 bash[9724]: cluster 2021-01-27T13:39:32.249661+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:34.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:33 smithi037 bash[13442]: cluster 2021-01-27T13:39:32.249661+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:36.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:35 smithi099 bash[9889]: cluster 2021-01-27T13:39:34.250800+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:36.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:35 smithi037 bash[13442]: cluster 2021-01-27T13:39:34.250800+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:36.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:35 smithi037 bash[9724]: cluster 2021-01-27T13:39:34.250800+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:38.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:37 smithi099 bash[9889]: cluster 2021-01-27T13:39:36.251446+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:38.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:39:37 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:39:38.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:37 smithi037 bash[9724]: cluster 2021-01-27T13:39:36.251446+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:38.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:37 smithi037 bash[13442]: cluster 2021-01-27T13:39:36.251446+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:38.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:39:37 smithi037 bash[9955]: debug 2021-01-27T13:39:37.845+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:39:39.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:39 smithi099 bash[9889]: audit 2021-01-27T13:39:37.848316+0000 mgr.y (mgr.14138) 468 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:39.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:39 smithi037 bash[9724]: audit 2021-01-27T13:39:37.848316+0000 mgr.y (mgr.14138) 468 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:39.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:39 smithi037 bash[13442]: audit 2021-01-27T13:39:37.848316+0000 mgr.y (mgr.14138) 468 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:40.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:40 smithi099 bash[9889]: cluster 2021-01-27T13:39:38.252374+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:40.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:40 smithi037 bash[9724]: cluster 2021-01-27T13:39:38.252374+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:40.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:40 smithi037 bash[13442]: cluster 2021-01-27T13:39:38.252374+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:42.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:42 smithi099 bash[9889]: cluster 2021-01-27T13:39:40.253340+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:42.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:42 smithi037 bash[9724]: cluster 2021-01-27T13:39:40.253340+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:42.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:42 smithi037 bash[13442]: cluster 2021-01-27T13:39:40.253340+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:44.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:44 smithi099 bash[9889]: cluster 2021-01-27T13:39:42.254368+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:44.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:44 smithi037 bash[13442]: cluster 2021-01-27T13:39:42.254368+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:44.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:44 smithi037 bash[9724]: cluster 2021-01-27T13:39:42.254368+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:46.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:46 smithi099 bash[9889]: cluster 2021-01-27T13:39:44.255517+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:46.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:46 smithi037 bash[13442]: cluster 2021-01-27T13:39:44.255517+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:46.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:46 smithi037 bash[9724]: cluster 2021-01-27T13:39:44.255517+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:48.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:48 smithi099 bash[9889]: cluster 2021-01-27T13:39:46.256607+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:48.312 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:39:47 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:39:48.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:48 smithi037 bash[13442]: cluster 2021-01-27T13:39:46.256607+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:48.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:39:47 smithi037 bash[9955]: debug 2021-01-27T13:39:47.849+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:39:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:48 smithi037 bash[9724]: cluster 2021-01-27T13:39:46.256607+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:49.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:49 smithi099 bash[9889]: audit 2021-01-27T13:39:47.851661+0000 mgr.y (mgr.14138) 474 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:49.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:49 smithi037 bash[13442]: audit 2021-01-27T13:39:47.851661+0000 mgr.y (mgr.14138) 474 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:49.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:49 smithi037 bash[9724]: audit 2021-01-27T13:39:47.851661+0000 mgr.y (mgr.14138) 474 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:50.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:50 smithi099 bash[9889]: cluster 2021-01-27T13:39:48.257590+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:50.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:50 smithi037 bash[9724]: cluster 2021-01-27T13:39:48.257590+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:50.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:50 smithi037 bash[13442]: cluster 2021-01-27T13:39:48.257590+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:52.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:52 smithi099 bash[9889]: cluster 2021-01-27T13:39:50.258583+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:52.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:52 smithi037 bash[9724]: cluster 2021-01-27T13:39:50.258583+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:52.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:52 smithi037 bash[13442]: cluster 2021-01-27T13:39:50.258583+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:54.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:54 smithi099 bash[9889]: cluster 2021-01-27T13:39:52.259534+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:54.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:54 smithi037 bash[9724]: cluster 2021-01-27T13:39:52.259534+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:54.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:54 smithi037 bash[13442]: cluster 2021-01-27T13:39:52.259534+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:56.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:56 smithi099 bash[9889]: cluster 2021-01-27T13:39:54.260616+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:56.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:56 smithi037 bash[9724]: cluster 2021-01-27T13:39:54.260616+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:56.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:56 smithi037 bash[13442]: cluster 2021-01-27T13:39:54.260616+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:39:57.087 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to '507028cb839c25d6666833702df6325fd8569096'. 2021-01-27T13:39:57.088 INFO:tasks.workunit.client.0.smithi037.stderr: 2021-01-27T13:39:57.088 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-01-27T13:39:57.088 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2021-01-27T13:39:57.088 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2021-01-27T13:39:57.089 INFO:tasks.workunit.client.0.smithi037.stderr: 2021-01-27T13:39:57.089 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2021-01-27T13:39:57.089 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2021-01-27T13:39:57.089 INFO:tasks.workunit.client.0.smithi037.stderr: 2021-01-27T13:39:57.089 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2021-01-27T13:39:57.090 INFO:tasks.workunit.client.0.smithi037.stderr: 2021-01-27T13:39:57.090 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2021-01-27T13:39:57.090 INFO:tasks.workunit.client.0.smithi037.stderr: 2021-01-27T13:39:57.090 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2021-01-27T13:39:57.091 INFO:tasks.workunit.client.0.smithi037.stderr: 2021-01-27T13:39:57.091 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-01-27T13:39:57.091 INFO:tasks.workunit.client.0.smithi037.stderr: 2021-01-27T13:39:57.091 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at 507028cb83 Merge branch 'wip-zabbix-ann' of https://github.com/tchaikov/ceph into wip-kefu-testing-2021-01-27-1353 2021-01-27T13:39:57.093 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-01-27T13:39:57.122 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-01-27T13:39:57.129 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-27T13:39:57.130 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-01-27T13:39:57.921 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-01-27T13:39:58.013 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-01-27T13:39:58.068 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-27T13:39:58.069 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-27T13:39:58.070 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-01-27T13:39:58.124 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-27T13:39:58.129 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2021-01-27T13:39:58.129 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-01-27T13:39:58.180 INFO:tasks.workunit:Running workunits matching rados/test_python.sh on client.0... 2021-01-27T13:39:58.182 INFO:tasks.workunit:Running workunit rados/test_python.sh... 2021-01-27T13:39:58.183 DEBUG:teuthology.orchestra.run.smithi037:workunit test rados/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=507028cb839c25d6666833702df6325fd8569096 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2021-01-27T13:39:58.196 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool create rbd 2021-01-27T13:39:58.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:58 smithi099 bash[9889]: cluster 2021-01-27T13:39:56.261681+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:58.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:39:57 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:39:58.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:39:57 smithi037 bash[9955]: debug 2021-01-27T13:39:57.860+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:39:58.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:58 smithi037 bash[9724]: cluster 2021-01-27T13:39:56.261681+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:58.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:58 smithi037 bash[13442]: cluster 2021-01-27T13:39:56.261681+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T13:39:59.156 INFO:tasks.workunit.client.0.smithi037.stderr:pool 'rbd' already exists 2021-01-27T13:39:59.169 INFO:tasks.workunit.client.0.smithi037.stderr:+ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2021-01-27T13:39:59.169 INFO:tasks.workunit.client.0.smithi037.stderr:+ python3 -m nose -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/../../../src/test/pybind/test_rados.py 2021-01-27T13:39:59.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:59 smithi099 bash[9889]: audit 2021-01-27T13:39:57.862949+0000 mgr.y (mgr.14138) 480 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:59.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:39:59 smithi099 bash[9889]: audit 2021-01-27T13:39:58.473446+0000 mon.a (mon.0) 658 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T13:39:59.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:59 smithi037 bash[9724]: audit 2021-01-27T13:39:57.862949+0000 mgr.y (mgr.14138) 480 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:59.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:39:59 smithi037 bash[9724]: audit 2021-01-27T13:39:58.473446+0000 mon.a (mon.0) 658 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T13:39:59.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:59 smithi037 bash[13442]: audit 2021-01-27T13:39:57.862949+0000 mgr.y (mgr.14138) 480 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:39:59.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:39:59 smithi037 bash[13442]: audit 2021-01-27T13:39:58.473446+0000 mon.a (mon.0) 658 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T13:40:00.102 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestCommand.test_ceph_osd_pool_create_utf8 ... ok 2021-01-27T13:40:00.150 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestCommand.test_monmap_dump ... ok 2021-01-27T13:40:00.164 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestCommand.test_osd_bench ... ok 2021-01-27T13:40:00.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:00 smithi099 bash[9889]: cluster 2021-01-27T13:39:58.262780+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:00.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:00 smithi099 bash[9889]: audit 2021-01-27T13:39:59.062893+0000 mon.a (mon.0) 659 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-27T13:40:00.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:00 smithi099 bash[9889]: cluster 2021-01-27T13:39:59.063143+0000 mon.a (mon.0) 660 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T13:40:00.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:00 smithi099 bash[9889]: audit 2021-01-27T13:39:59.153115+0000 mon.a (mon.0) 661 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T13:40:00.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:00 smithi037 bash[9724]: cluster 2021-01-27T13:39:58.262780+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:00.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:00 smithi037 bash[9724]: audit 2021-01-27T13:39:59.062893+0000 mon.a (mon.0) 659 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-27T13:40:00.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:00 smithi037 bash[9724]: cluster 2021-01-27T13:39:59.063143+0000 mon.a (mon.0) 660 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T13:40:00.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:00 smithi037 bash[9724]: audit 2021-01-27T13:39:59.153115+0000 mon.a (mon.0) 661 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T13:40:00.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:00 smithi037 bash[13442]: cluster 2021-01-27T13:39:58.262780+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:00.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:00 smithi037 bash[13442]: audit 2021-01-27T13:39:59.062893+0000 mon.a (mon.0) 659 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-27T13:40:00.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:00 smithi037 bash[13442]: cluster 2021-01-27T13:39:59.063143+0000 mon.a (mon.0) 660 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T13:40:00.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:00 smithi037 bash[13442]: audit 2021-01-27T13:39:59.153115+0000 mon.a (mon.0) 661 : audit [INF] from='client.? 172.21.15.37:0/1180184767' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T13:40:01.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:01 smithi099 bash[9889]: audit 2021-01-27T13:39:59.643683+0000 mon.a (mon.0) 662 : audit [INF] from='client.? 172.21.15.37:0/3517414055' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T13:40:01.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:01 smithi099 bash[9889]: cluster 2021-01-27T13:40:00.095364+0000 mon.a (mon.0) 663 : cluster [INF] overall HEALTH_OK 2021-01-27T13:40:01.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:01 smithi099 bash[9889]: audit 2021-01-27T13:40:00.101914+0000 mon.a (mon.0) 664 : audit [INF] from='client.? 172.21.15.37:0/3517414055' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-27T13:40:01.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:01 smithi099 bash[9889]: cluster 2021-01-27T13:40:00.101969+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T13:40:01.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:01 smithi099 bash[9889]: audit 2021-01-27T13:40:00.131698+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-27T13:40:01.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:01 smithi099 bash[9889]: audit 2021-01-27T13:40:00.135579+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T13:40:01.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:01 smithi099 bash[9889]: audit 2021-01-27T13:40:00.136531+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-27T13:40:01.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[9724]: audit 2021-01-27T13:39:59.643683+0000 mon.a (mon.0) 662 : audit [INF] from='client.? 172.21.15.37:0/3517414055' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T13:40:01.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[9724]: cluster 2021-01-27T13:40:00.095364+0000 mon.a (mon.0) 663 : cluster [INF] overall HEALTH_OK 2021-01-27T13:40:01.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[9724]: audit 2021-01-27T13:40:00.101914+0000 mon.a (mon.0) 664 : audit [INF] from='client.? 172.21.15.37:0/3517414055' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-27T13:40:01.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[9724]: cluster 2021-01-27T13:40:00.101969+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T13:40:01.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[9724]: audit 2021-01-27T13:40:00.131698+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-27T13:40:01.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[9724]: audit 2021-01-27T13:40:00.135579+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T13:40:01.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[9724]: audit 2021-01-27T13:40:00.136531+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-27T13:40:01.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[13442]: audit 2021-01-27T13:39:59.643683+0000 mon.a (mon.0) 662 : audit [INF] from='client.? 172.21.15.37:0/3517414055' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T13:40:01.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[13442]: cluster 2021-01-27T13:40:00.095364+0000 mon.a (mon.0) 663 : cluster [INF] overall HEALTH_OK 2021-01-27T13:40:01.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[13442]: audit 2021-01-27T13:40:00.101914+0000 mon.a (mon.0) 664 : audit [INF] from='client.? 172.21.15.37:0/3517414055' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-27T13:40:01.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[13442]: cluster 2021-01-27T13:40:00.101969+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T13:40:01.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[13442]: audit 2021-01-27T13:40:00.131698+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-27T13:40:01.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[13442]: audit 2021-01-27T13:40:00.135579+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T13:40:01.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:01 smithi037 bash[13442]: audit 2021-01-27T13:40:00.136531+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? 172.21.15.37:0/4205721858' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-27T13:40:02.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:02 smithi099 bash[9889]: cluster 2021-01-27T13:40:00.263612+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v347: 180 pgs: 8 creating+peering, 37 unknown, 135 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T13:40:02.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:02 smithi099 bash[9889]: cluster 2021-01-27T13:40:01.132857+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T13:40:02.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:02 smithi037 bash[9724]: cluster 2021-01-27T13:40:00.263612+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v347: 180 pgs: 8 creating+peering, 37 unknown, 135 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T13:40:02.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:02 smithi037 bash[9724]: cluster 2021-01-27T13:40:01.132857+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T13:40:02.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:02 smithi037 bash[13442]: cluster 2021-01-27T13:40:00.263612+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v347: 180 pgs: 8 creating+peering, 37 unknown, 135 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T13:40:02.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:02 smithi037 bash[13442]: cluster 2021-01-27T13:40:01.132857+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T13:40:03.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:03 smithi099 bash[9889]: cluster 2021-01-27T13:40:02.142053+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T13:40:03.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:03 smithi099 bash[9889]: cluster 2021-01-27T13:40:02.264505+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v350: 212 pgs: 17 creating+peering, 42 unknown, 153 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:40:03.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:03 smithi037 bash[9724]: cluster 2021-01-27T13:40:02.142053+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T13:40:03.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:03 smithi037 bash[9724]: cluster 2021-01-27T13:40:02.264505+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v350: 212 pgs: 17 creating+peering, 42 unknown, 153 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:40:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:03 smithi037 bash[13442]: cluster 2021-01-27T13:40:02.142053+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T13:40:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:03 smithi037 bash[13442]: cluster 2021-01-27T13:40:02.264505+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v350: 212 pgs: 17 creating+peering, 42 unknown, 153 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:40:04.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:04 smithi099 bash[9889]: cluster 2021-01-27T13:40:03.156630+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T13:40:04.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:04 smithi037 bash[9724]: cluster 2021-01-27T13:40:03.156630+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T13:40:04.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:04 smithi037 bash[13442]: cluster 2021-01-27T13:40:03.156630+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T13:40:05.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:05 smithi099 bash[9889]: cluster 2021-01-27T13:40:04.172048+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T13:40:05.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:05 smithi099 bash[9889]: cluster 2021-01-27T13:40:04.265660+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v353: 212 pgs: 10 creating+peering, 9 unknown, 193 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T13:40:05.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:05 smithi037 bash[9724]: cluster 2021-01-27T13:40:04.172048+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T13:40:05.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:05 smithi037 bash[9724]: cluster 2021-01-27T13:40:04.265660+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v353: 212 pgs: 10 creating+peering, 9 unknown, 193 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T13:40:05.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:05 smithi037 bash[13442]: cluster 2021-01-27T13:40:04.172048+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T13:40:05.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:05 smithi037 bash[13442]: cluster 2021-01-27T13:40:04.265660+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v353: 212 pgs: 10 creating+peering, 9 unknown, 193 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T13:40:06.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:06 smithi099 bash[9889]: cluster 2021-01-27T13:40:05.179621+0000 mon.a (mon.0) 673 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:06.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:06 smithi099 bash[9889]: cluster 2021-01-27T13:40:05.193503+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T13:40:06.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:06 smithi037 bash[9724]: cluster 2021-01-27T13:40:05.179621+0000 mon.a (mon.0) 673 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:06.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:06 smithi037 bash[9724]: cluster 2021-01-27T13:40:05.193503+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T13:40:06.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:06 smithi037 bash[13442]: cluster 2021-01-27T13:40:05.179621+0000 mon.a (mon.0) 673 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:06.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:06 smithi037 bash[13442]: cluster 2021-01-27T13:40:05.193503+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T13:40:07.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:07 smithi099 bash[9889]: cluster 2021-01-27T13:40:06.200327+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T13:40:07.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:07 smithi099 bash[9889]: audit 2021-01-27T13:40:06.204279+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.37:0/4195305750' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:07.565 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:07 smithi099 bash[9889]: cluster 2021-01-27T13:40:06.266630+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v356: 212 pgs: 5 creating+peering, 207 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T13:40:07.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:07 smithi037 bash[9724]: cluster 2021-01-27T13:40:06.200327+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T13:40:07.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:07 smithi037 bash[9724]: audit 2021-01-27T13:40:06.204279+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.37:0/4195305750' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:07.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:07 smithi037 bash[9724]: cluster 2021-01-27T13:40:06.266630+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v356: 212 pgs: 5 creating+peering, 207 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T13:40:07.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:07 smithi037 bash[13442]: cluster 2021-01-27T13:40:06.200327+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T13:40:07.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:07 smithi037 bash[13442]: audit 2021-01-27T13:40:06.204279+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.37:0/4195305750' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:07.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:07 smithi037 bash[13442]: cluster 2021-01-27T13:40:06.266630+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v356: 212 pgs: 5 creating+peering, 207 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-27T13:40:08.221 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:40:07 smithi037 bash[9955]: debug 2021-01-27T13:40:07.868+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:40:08.222 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:08 smithi037 bash[9724]: audit 2021-01-27T13:40:07.210829+0000 mon.a (mon.0) 677 : audit [INF] from='client.? 172.21.15.37:0/4195305750' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:08.222 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:08 smithi037 bash[9724]: cluster 2021-01-27T13:40:07.211078+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T13:40:08.222 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:08 smithi037 bash[9724]: audit 2021-01-27T13:40:07.871780+0000 mgr.y (mgr.14138) 486 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:08.222 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoCtxSelfManagedSnaps.test ... ok 2021-01-27T13:40:08.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:40:07 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:40:08.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:08 smithi099 bash[9889]: audit 2021-01-27T13:40:07.210829+0000 mon.a (mon.0) 677 : audit [INF] from='client.? 172.21.15.37:0/4195305750' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:08.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:08 smithi099 bash[9889]: cluster 2021-01-27T13:40:07.211078+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T13:40:08.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:08 smithi099 bash[9889]: audit 2021-01-27T13:40:07.871780+0000 mgr.y (mgr.14138) 486 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:08.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:08 smithi037 bash[13442]: audit 2021-01-27T13:40:07.210829+0000 mon.a (mon.0) 677 : audit [INF] from='client.? 172.21.15.37:0/4195305750' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:08.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:08 smithi037 bash[13442]: cluster 2021-01-27T13:40:07.211078+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T13:40:08.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:08 smithi037 bash[13442]: audit 2021-01-27T13:40:07.871780+0000 mgr.y (mgr.14138) 486 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:09.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:09 smithi099 bash[9889]: cluster 2021-01-27T13:40:08.213196+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T13:40:09.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:09 smithi099 bash[9889]: cluster 2021-01-27T13:40:08.267485+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v359: 180 pgs: 180 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:09.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:09 smithi037 bash[9724]: cluster 2021-01-27T13:40:08.213196+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T13:40:09.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:09 smithi037 bash[9724]: cluster 2021-01-27T13:40:08.267485+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v359: 180 pgs: 180 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:09.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:09 smithi037 bash[13442]: cluster 2021-01-27T13:40:08.213196+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T13:40:09.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:09 smithi037 bash[13442]: cluster 2021-01-27T13:40:08.267485+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v359: 180 pgs: 180 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:10.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:10 smithi099 bash[9889]: cluster 2021-01-27T13:40:09.218004+0000 mon.a (mon.0) 680 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:10.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:10 smithi099 bash[9889]: cluster 2021-01-27T13:40:09.218106+0000 mon.a (mon.0) 681 : cluster [INF] Cluster is now healthy 2021-01-27T13:40:10.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:10 smithi099 bash[9889]: cluster 2021-01-27T13:40:09.241201+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T13:40:10.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:10 smithi037 bash[9724]: cluster 2021-01-27T13:40:09.218004+0000 mon.a (mon.0) 680 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:10.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:10 smithi037 bash[9724]: cluster 2021-01-27T13:40:09.218106+0000 mon.a (mon.0) 681 : cluster [INF] Cluster is now healthy 2021-01-27T13:40:10.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:10 smithi037 bash[9724]: cluster 2021-01-27T13:40:09.241201+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T13:40:10.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:10 smithi037 bash[13442]: cluster 2021-01-27T13:40:09.218004+0000 mon.a (mon.0) 680 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:10.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:10 smithi037 bash[13442]: cluster 2021-01-27T13:40:09.218106+0000 mon.a (mon.0) 681 : cluster [INF] Cluster is now healthy 2021-01-27T13:40:10.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:10 smithi037 bash[13442]: cluster 2021-01-27T13:40:09.241201+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T13:40:11.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:11 smithi099 bash[9889]: cluster 2021-01-27T13:40:10.249866+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T13:40:11.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:11 smithi099 bash[9889]: cluster 2021-01-27T13:40:10.268114+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v362: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:11.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:11 smithi099 bash[9889]: audit 2021-01-27T13:40:10.311777+0000 mon.a (mon.0) 684 : audit [INF] from='client.? 172.21.15.37:0/4110738643' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:11.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:11 smithi037 bash[9724]: cluster 2021-01-27T13:40:10.249866+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T13:40:11.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:11 smithi037 bash[9724]: cluster 2021-01-27T13:40:10.268114+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v362: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:11.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:11 smithi037 bash[9724]: audit 2021-01-27T13:40:10.311777+0000 mon.a (mon.0) 684 : audit [INF] from='client.? 172.21.15.37:0/4110738643' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:11.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:11 smithi037 bash[13442]: cluster 2021-01-27T13:40:10.249866+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T13:40:11.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:11 smithi037 bash[13442]: cluster 2021-01-27T13:40:10.268114+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v362: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:11.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:11 smithi037 bash[13442]: audit 2021-01-27T13:40:10.311777+0000 mon.a (mon.0) 684 : audit [INF] from='client.? 172.21.15.37:0/4110738643' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:12.318 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_append ... ok 2021-01-27T13:40:12.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:12 smithi037 bash[9724]: audit 2021-01-27T13:40:11.305715+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.37:0/4110738643' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:12.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:12 smithi037 bash[9724]: cluster 2021-01-27T13:40:11.305791+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T13:40:12.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:12 smithi037 bash[13442]: audit 2021-01-27T13:40:11.305715+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.37:0/4110738643' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:12.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:12 smithi037 bash[13442]: cluster 2021-01-27T13:40:11.305791+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T13:40:12.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:12 smithi099 bash[9889]: audit 2021-01-27T13:40:11.305715+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.37:0/4110738643' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:12.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:12 smithi099 bash[9889]: cluster 2021-01-27T13:40:11.305791+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T13:40:13.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:13 smithi099 bash[9889]: cluster 2021-01-27T13:40:12.269089+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v364: 212 pgs: 2 creating+activating, 5 creating+peering, 12 unknown, 193 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 504 B/s wr, 2 op/s 2021-01-27T13:40:13.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:13 smithi099 bash[9889]: cluster 2021-01-27T13:40:12.311641+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T13:40:13.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:13 smithi037 bash[9724]: cluster 2021-01-27T13:40:12.269089+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v364: 212 pgs: 2 creating+activating, 5 creating+peering, 12 unknown, 193 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 504 B/s wr, 2 op/s 2021-01-27T13:40:13.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:13 smithi037 bash[9724]: cluster 2021-01-27T13:40:12.311641+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T13:40:13.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:13 smithi037 bash[13442]: cluster 2021-01-27T13:40:12.269089+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v364: 212 pgs: 2 creating+activating, 5 creating+peering, 12 unknown, 193 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 504 B/s wr, 2 op/s 2021-01-27T13:40:13.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:13 smithi037 bash[13442]: cluster 2021-01-27T13:40:12.311641+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T13:40:14.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:14 smithi099 bash[9889]: cluster 2021-01-27T13:40:13.342311+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T13:40:14.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:14 smithi099 bash[9889]: audit 2021-01-27T13:40:14.307313+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:40:14.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:14 smithi099 bash[9889]: audit 2021-01-27T13:40:14.307764+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:40:14.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:14 smithi037 bash[9724]: cluster 2021-01-27T13:40:13.342311+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T13:40:14.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:14 smithi037 bash[9724]: audit 2021-01-27T13:40:14.307313+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:40:14.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:14 smithi037 bash[9724]: audit 2021-01-27T13:40:14.307764+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:40:14.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:14 smithi037 bash[13442]: cluster 2021-01-27T13:40:13.342311+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T13:40:14.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:14 smithi037 bash[13442]: audit 2021-01-27T13:40:14.307313+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:40:14.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:14 smithi037 bash[13442]: audit 2021-01-27T13:40:14.307764+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:40:15.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:15 smithi099 bash[9889]: cluster 2021-01-27T13:40:14.270116+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v367: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:15.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:15 smithi099 bash[9889]: cluster 2021-01-27T13:40:14.345598+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T13:40:15.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:15 smithi099 bash[9889]: audit 2021-01-27T13:40:14.384038+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.37:0/150682964' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:15.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:15 smithi099 bash[9889]: audit 2021-01-27T13:40:14.384364+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:15.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:15 smithi037 bash[9724]: cluster 2021-01-27T13:40:14.270116+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v367: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:15 smithi037 bash[9724]: cluster 2021-01-27T13:40:14.345598+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T13:40:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:15 smithi037 bash[9724]: audit 2021-01-27T13:40:14.384038+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.37:0/150682964' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:15 smithi037 bash[9724]: audit 2021-01-27T13:40:14.384364+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:15.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:15 smithi037 bash[13442]: cluster 2021-01-27T13:40:14.270116+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v367: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:15.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:15 smithi037 bash[13442]: cluster 2021-01-27T13:40:14.345598+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T13:40:15.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:15 smithi037 bash[13442]: audit 2021-01-27T13:40:14.384038+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.37:0/150682964' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:15.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:15 smithi037 bash[13442]: audit 2021-01-27T13:40:14.384364+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:16.381 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_cmpext ... ok 2021-01-27T13:40:16.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:16 smithi099 bash[9889]: audit 2021-01-27T13:40:15.368755+0000 mon.a (mon.0) 693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:16.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:16 smithi099 bash[9889]: cluster 2021-01-27T13:40:15.368921+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T13:40:16.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:16 smithi037 bash[9724]: audit 2021-01-27T13:40:15.368755+0000 mon.a (mon.0) 693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:16.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:16 smithi037 bash[9724]: cluster 2021-01-27T13:40:15.368921+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T13:40:16.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:16 smithi037 bash[13442]: audit 2021-01-27T13:40:15.368755+0000 mon.a (mon.0) 693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:16.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:16 smithi037 bash[13442]: cluster 2021-01-27T13:40:15.368921+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T13:40:17.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:17 smithi099 bash[9889]: cluster 2021-01-27T13:40:16.271061+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v370: 212 pgs: 3 creating+peering, 19 unknown, 190 active+clean; 25 KiB data, 63 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:40:17.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:17 smithi099 bash[9889]: cluster 2021-01-27T13:40:16.374773+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T13:40:17.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:17 smithi037 bash[9724]: cluster 2021-01-27T13:40:16.271061+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v370: 212 pgs: 3 creating+peering, 19 unknown, 190 active+clean; 25 KiB data, 63 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:40:17.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:17 smithi037 bash[9724]: cluster 2021-01-27T13:40:16.374773+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T13:40:17.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:17 smithi037 bash[13442]: cluster 2021-01-27T13:40:16.271061+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v370: 212 pgs: 3 creating+peering, 19 unknown, 190 active+clean; 25 KiB data, 63 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:40:17.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:17 smithi037 bash[13442]: cluster 2021-01-27T13:40:16.374773+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T13:40:18.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:40:17 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:40:18.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:40:17 smithi037 bash[9955]: debug 2021-01-27T13:40:17.880+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:40:18.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:18 smithi099 bash[9889]: cluster 2021-01-27T13:40:17.401409+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T13:40:18.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:18 smithi099 bash[9889]: audit 2021-01-27T13:40:17.883155+0000 mgr.y (mgr.14138) 492 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:18.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:18 smithi037 bash[9724]: cluster 2021-01-27T13:40:17.401409+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T13:40:18.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:18 smithi037 bash[9724]: audit 2021-01-27T13:40:17.883155+0000 mgr.y (mgr.14138) 492 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:18.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:18 smithi037 bash[13442]: cluster 2021-01-27T13:40:17.401409+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T13:40:18.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:18 smithi037 bash[13442]: audit 2021-01-27T13:40:17.883155+0000 mgr.y (mgr.14138) 492 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:19.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:19 smithi099 bash[9889]: cluster 2021-01-27T13:40:18.272179+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v373: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:19.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:19 smithi099 bash[9889]: cluster 2021-01-27T13:40:18.410088+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T13:40:19.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:19 smithi099 bash[9889]: audit 2021-01-27T13:40:18.475421+0000 mon.a (mon.0) 698 : audit [INF] from='client.? 172.21.15.37:0/1617112228' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:19.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:19 smithi037 bash[13442]: cluster 2021-01-27T13:40:18.272179+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v373: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:19.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:19 smithi037 bash[13442]: cluster 2021-01-27T13:40:18.410088+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T13:40:19.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:19 smithi037 bash[13442]: audit 2021-01-27T13:40:18.475421+0000 mon.a (mon.0) 698 : audit [INF] from='client.? 172.21.15.37:0/1617112228' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:19.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:19 smithi037 bash[9724]: cluster 2021-01-27T13:40:18.272179+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v373: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:19.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:19 smithi037 bash[9724]: cluster 2021-01-27T13:40:18.410088+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T13:40:19.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:19 smithi037 bash[9724]: audit 2021-01-27T13:40:18.475421+0000 mon.a (mon.0) 698 : audit [INF] from='client.? 172.21.15.37:0/1617112228' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:20.429 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_execute ... ok 2021-01-27T13:40:20.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:20 smithi099 bash[9889]: audit 2021-01-27T13:40:19.416767+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.37:0/1617112228' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:20.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:20 smithi099 bash[9889]: cluster 2021-01-27T13:40:19.417293+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T13:40:20.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:20 smithi099 bash[9889]: cluster 2021-01-27T13:40:20.421998+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T13:40:20.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:20 smithi037 bash[9724]: audit 2021-01-27T13:40:19.416767+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.37:0/1617112228' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:20.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:20 smithi037 bash[9724]: cluster 2021-01-27T13:40:19.417293+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T13:40:20.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:20 smithi037 bash[9724]: cluster 2021-01-27T13:40:20.421998+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T13:40:20.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:20 smithi037 bash[13442]: audit 2021-01-27T13:40:19.416767+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.37:0/1617112228' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:20.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:20 smithi037 bash[13442]: cluster 2021-01-27T13:40:19.417293+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T13:40:20.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:20 smithi037 bash[13442]: cluster 2021-01-27T13:40:20.421998+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T13:40:21.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:21 smithi099 bash[9889]: cluster 2021-01-27T13:40:20.273171+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v376: 212 pgs: 7 creating+peering, 13 unknown, 192 active+clean; 25 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:21.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:21 smithi037 bash[9724]: cluster 2021-01-27T13:40:20.273171+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v376: 212 pgs: 7 creating+peering, 13 unknown, 192 active+clean; 25 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:21.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:21 smithi037 bash[13442]: cluster 2021-01-27T13:40:20.273171+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v376: 212 pgs: 7 creating+peering, 13 unknown, 192 active+clean; 25 KiB data, 72 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:22.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:22 smithi099 bash[9889]: cluster 2021-01-27T13:40:21.459440+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T13:40:22.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:22 smithi099 bash[9889]: cluster 2021-01-27T13:40:22.459263+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T13:40:22.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:22 smithi037 bash[9724]: cluster 2021-01-27T13:40:21.459440+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T13:40:22.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:22 smithi037 bash[9724]: cluster 2021-01-27T13:40:22.459263+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T13:40:22.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:22 smithi037 bash[13442]: cluster 2021-01-27T13:40:21.459440+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T13:40:22.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:22 smithi037 bash[13442]: cluster 2021-01-27T13:40:22.459263+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T13:40:23.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:23 smithi099 bash[9889]: cluster 2021-01-27T13:40:22.274212+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v379: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 77 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:40:23.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:23 smithi099 bash[9889]: audit 2021-01-27T13:40:22.492174+0000 mon.a (mon.0) 704 : audit [DBG] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T13:40:23.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:23 smithi099 bash[9889]: audit 2021-01-27T13:40:22.492820+0000 mon.a (mon.0) 705 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:23.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:23 smithi099 bash[9889]: cluster 2021-01-27T13:40:23.469379+0000 mon.a (mon.0) 706 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:23.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:23 smithi099 bash[9889]: audit 2021-01-27T13:40:23.477882+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:23.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:23 smithi099 bash[9889]: cluster 2021-01-27T13:40:23.478011+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-27T13:40:23.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[13442]: cluster 2021-01-27T13:40:22.274212+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v379: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 77 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:40:23.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[13442]: audit 2021-01-27T13:40:22.492174+0000 mon.a (mon.0) 704 : audit [DBG] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T13:40:23.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[13442]: audit 2021-01-27T13:40:22.492820+0000 mon.a (mon.0) 705 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:23.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[13442]: cluster 2021-01-27T13:40:23.469379+0000 mon.a (mon.0) 706 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:23.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[13442]: audit 2021-01-27T13:40:23.477882+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:23.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[13442]: cluster 2021-01-27T13:40:23.478011+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-27T13:40:23.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[9724]: debug 2021-01-27T13:40:23.476+0000 7ff30b0f8700 -1 mon.a@0(leader).osd e87 definitely_dead 0 2021-01-27T13:40:23.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[9724]: cluster 2021-01-27T13:40:22.274212+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v379: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 77 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:40:23.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[9724]: audit 2021-01-27T13:40:22.492174+0000 mon.a (mon.0) 704 : audit [DBG] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T13:40:23.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[9724]: audit 2021-01-27T13:40:22.492820+0000 mon.a (mon.0) 705 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:23.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[9724]: cluster 2021-01-27T13:40:23.469379+0000 mon.a (mon.0) 706 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:23.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[9724]: audit 2021-01-27T13:40:23.477882+0000 mon.a (mon.0) 707 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:23.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:23 smithi037 bash[9724]: cluster 2021-01-27T13:40:23.478011+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-27T13:40:24.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:24 smithi099 bash[9889]: audit 2021-01-27T13:40:23.481374+0000 mon.a (mon.0) 709 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T13:40:24.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:24 smithi099 bash[9889]: cluster 2021-01-27T13:40:24.473309+0000 mon.a (mon.0) 710 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:24.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:24 smithi099 bash[9889]: audit 2021-01-27T13:40:24.483120+0000 mon.a (mon.0) 711 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-27T13:40:24.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:24 smithi099 bash[9889]: cluster 2021-01-27T13:40:24.485723+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-27T13:40:24.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:24 smithi037 bash[9724]: audit 2021-01-27T13:40:23.481374+0000 mon.a (mon.0) 709 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T13:40:24.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:24 smithi037 bash[9724]: cluster 2021-01-27T13:40:24.473309+0000 mon.a (mon.0) 710 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:24.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:24 smithi037 bash[9724]: audit 2021-01-27T13:40:24.483120+0000 mon.a (mon.0) 711 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-27T13:40:24.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:24 smithi037 bash[9724]: cluster 2021-01-27T13:40:24.485723+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-27T13:40:24.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:24 smithi037 bash[13442]: audit 2021-01-27T13:40:23.481374+0000 mon.a (mon.0) 709 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T13:40:24.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:24 smithi037 bash[13442]: cluster 2021-01-27T13:40:24.473309+0000 mon.a (mon.0) 710 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:24.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:24 smithi037 bash[13442]: audit 2021-01-27T13:40:24.483120+0000 mon.a (mon.0) 711 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-27T13:40:24.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:24 smithi037 bash[13442]: cluster 2021-01-27T13:40:24.485723+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-27T13:40:26.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:25 smithi099 bash[9889]: cluster 2021-01-27T13:40:24.275317+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v382: 212 pgs: 4 creating+peering, 13 unknown, 195 active+clean; 25 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:26.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:25 smithi099 bash[9889]: cluster 2021-01-27T13:40:25.487366+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-27T13:40:26.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:25 smithi037 bash[9724]: cluster 2021-01-27T13:40:24.275317+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v382: 212 pgs: 4 creating+peering, 13 unknown, 195 active+clean; 25 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:26.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:25 smithi037 bash[9724]: cluster 2021-01-27T13:40:25.487366+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-27T13:40:26.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:25 smithi037 bash[13442]: cluster 2021-01-27T13:40:24.275317+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v382: 212 pgs: 4 creating+peering, 13 unknown, 195 active+clean; 25 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:40:26.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:25 smithi037 bash[13442]: cluster 2021-01-27T13:40:25.487366+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-27T13:40:27.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:26 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.643019+0000 mon.a (mon.0) 714 : cluster [INF] osd.4 marked itself dead as of e89 2021-01-27T13:40:27.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:26 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.827348+0000 mon.a (mon.0) 715 : cluster [INF] osd.3 marked itself dead as of e89 2021-01-27T13:40:27.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:26 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.885901+0000 mon.a (mon.0) 716 : cluster [INF] osd.5 marked itself dead as of e89 2021-01-27T13:40:27.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:26 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.643019+0000 mon.a (mon.0) 714 : cluster [INF] osd.4 marked itself dead as of e89 2021-01-27T13:40:27.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:26 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.827348+0000 mon.a (mon.0) 715 : cluster [INF] osd.3 marked itself dead as of e89 2021-01-27T13:40:27.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:26 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.885901+0000 mon.a (mon.0) 716 : cluster [INF] osd.5 marked itself dead as of e89 2021-01-27T13:40:27.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:26 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.643019+0000 mon.a (mon.0) 714 : cluster [INF] osd.4 marked itself dead as of e89 2021-01-27T13:40:27.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:26 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.827348+0000 mon.a (mon.0) 715 : cluster [INF] osd.3 marked itself dead as of e89 2021-01-27T13:40:27.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:26 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.885901+0000 mon.a (mon.0) 716 : cluster [INF] osd.5 marked itself dead as of e89 2021-01-27T13:40:27.809 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[12776]: debug 2021-01-27T13:40:27.384+0000 7fa013f7a700 -1 osd.4 90 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:27.946 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9955]: debug 2021-01-27T13:40:27.892+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:40:27.947 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[24020]: debug 2021-01-27T13:40:27.656+0000 7ff8bc27f700 -1 osd.3 90 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:28.061 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[15271]: debug 2021-01-27T13:40:27.804+0000 7fa0b7787700 -1 osd.5 90 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:28.061 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:40:28.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.276932+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v385: 212 pgs: 157 active+clean, 18 stale+active+clean, 2 undersized+degraded+peered+wait, 4 stale+creating+peering, 11 active+undersized+degraded+wait, 11 active+undersized+wait, 9 undersized+peered+wait; 25 KiB data, 83 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 96/978 objects degraded (9.816%) 2021-01-27T13:40:28.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.641765+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T13:40:28.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.641775+0000 osd.4 (osd.4) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.825230+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-27T13:40:28.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.825243+0000 osd.3 (osd.3) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.884639+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-27T13:40:28.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.884647+0000 osd.5 (osd.5) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.942376+0000 mon.a (mon.0) 717 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive (PG_AVAILABILITY) 2021-01-27T13:40:28.063 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.942455+0000 mon.a (mon.0) 718 : cluster [WRN] Health check failed: Degraded data redundancy: 96/978 objects degraded (9.816%), 13 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:28.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.942518+0000 mon.a (mon.0) 719 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:28.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: cluster 2021-01-27T13:40:26.957304+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-27T13:40:28.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:27 smithi099 bash[9889]: audit 2021-01-27T13:40:27.492739+0000 mon.a (mon.0) 721 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:28.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.276932+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v385: 212 pgs: 157 active+clean, 18 stale+active+clean, 2 undersized+degraded+peered+wait, 4 stale+creating+peering, 11 active+undersized+degraded+wait, 11 active+undersized+wait, 9 undersized+peered+wait; 25 KiB data, 83 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 96/978 objects degraded (9.816%) 2021-01-27T13:40:28.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.641765+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T13:40:28.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.641775+0000 osd.4 (osd.4) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.825230+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-27T13:40:28.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.825243+0000 osd.3 (osd.3) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.884639+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-27T13:40:28.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.884647+0000 osd.5 (osd.5) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.942376+0000 mon.a (mon.0) 717 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive (PG_AVAILABILITY) 2021-01-27T13:40:28.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.942455+0000 mon.a (mon.0) 718 : cluster [WRN] Health check failed: Degraded data redundancy: 96/978 objects degraded (9.816%), 13 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:28.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.942518+0000 mon.a (mon.0) 719 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:28.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: cluster 2021-01-27T13:40:26.957304+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-27T13:40:28.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[9724]: audit 2021-01-27T13:40:27.492739+0000 mon.a (mon.0) 721 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:28.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.276932+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v385: 212 pgs: 157 active+clean, 18 stale+active+clean, 2 undersized+degraded+peered+wait, 4 stale+creating+peering, 11 active+undersized+degraded+wait, 11 active+undersized+wait, 9 undersized+peered+wait; 25 KiB data, 83 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 96/978 objects degraded (9.816%) 2021-01-27T13:40:28.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.641765+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T13:40:28.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.641775+0000 osd.4 (osd.4) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.825230+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-27T13:40:28.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.825243+0000 osd.3 (osd.3) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.884639+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-27T13:40:28.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.884647+0000 osd.5 (osd.5) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-27T13:40:28.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.942376+0000 mon.a (mon.0) 717 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive (PG_AVAILABILITY) 2021-01-27T13:40:28.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.942455+0000 mon.a (mon.0) 718 : cluster [WRN] Health check failed: Degraded data redundancy: 96/978 objects degraded (9.816%), 13 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:28.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.942518+0000 mon.a (mon.0) 719 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:28.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: cluster 2021-01-27T13:40:26.957304+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-27T13:40:28.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:27 smithi037 bash[13442]: audit 2021-01-27T13:40:27.492739+0000 mon.a (mon.0) 721 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:29.244 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:28 smithi099 bash[9889]: audit 2021-01-27T13:40:27.894431+0000 mgr.y (mgr.14138) 498 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:29.245 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:28 smithi099 bash[9889]: cluster 2021-01-27T13:40:27.955720+0000 mon.a (mon.0) 722 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:29.245 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:28 smithi099 bash[9889]: audit 2021-01-27T13:40:27.965599+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:29.246 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:28 smithi099 bash[9889]: cluster 2021-01-27T13:40:27.965899+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e91: 8 total, 5 up, 8 in 2021-01-27T13:40:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:28 smithi037 bash[9724]: audit 2021-01-27T13:40:27.894431+0000 mgr.y (mgr.14138) 498 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:28 smithi037 bash[9724]: cluster 2021-01-27T13:40:27.955720+0000 mon.a (mon.0) 722 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:28 smithi037 bash[9724]: audit 2021-01-27T13:40:27.965599+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:28 smithi037 bash[9724]: cluster 2021-01-27T13:40:27.965899+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e91: 8 total, 5 up, 8 in 2021-01-27T13:40:29.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:28 smithi037 bash[13442]: audit 2021-01-27T13:40:27.894431+0000 mgr.y (mgr.14138) 498 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:29.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:28 smithi037 bash[13442]: cluster 2021-01-27T13:40:27.955720+0000 mon.a (mon.0) 722 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:29.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:28 smithi037 bash[13442]: audit 2021-01-27T13:40:27.965599+0000 mon.a (mon.0) 723 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:29.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:28 smithi037 bash[13442]: cluster 2021-01-27T13:40:27.965899+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e91: 8 total, 5 up, 8 in 2021-01-27T13:40:30.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: cluster 2021-01-27T13:40:28.278040+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v388: 212 pgs: 18 undersized+peered, 40 active+undersized, 70 active+clean, 32 stale+active+clean, 2 undersized+degraded+peered+wait, 11 active+undersized+degraded+wait, 7 undersized+degraded+peered, 12 active+undersized+degraded, 11 active+undersized+wait, 9 undersized+peered+wait; 25 KiB data, 88 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 259/978 objects degraded (26.483%) 2021-01-27T13:40:30.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: cluster 2021-01-27T13:40:28.960618+0000 mon.a (mon.0) 725 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:30.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: cluster 2021-01-27T13:40:28.969989+0000 mon.a (mon.0) 726 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:40:30.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: cluster 2021-01-27T13:40:28.970077+0000 mon.a (mon.0) 727 : cluster [INF] osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921] boot 2021-01-27T13:40:30.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: cluster 2021-01-27T13:40:28.970134+0000 mon.a (mon.0) 728 : cluster [INF] osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695] boot 2021-01-27T13:40:30.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: cluster 2021-01-27T13:40:28.970184+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T13:40:30.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: audit 2021-01-27T13:40:28.978714+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:40:30.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: audit 2021-01-27T13:40:28.979370+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:40:30.315 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:29 smithi099 bash[9889]: audit 2021-01-27T13:40:28.979784+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:40:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: cluster 2021-01-27T13:40:28.278040+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v388: 212 pgs: 18 undersized+peered, 40 active+undersized, 70 active+clean, 32 stale+active+clean, 2 undersized+degraded+peered+wait, 11 active+undersized+degraded+wait, 7 undersized+degraded+peered, 12 active+undersized+degraded, 11 active+undersized+wait, 9 undersized+peered+wait; 25 KiB data, 88 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 259/978 objects degraded (26.483%) 2021-01-27T13:40:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: cluster 2021-01-27T13:40:28.960618+0000 mon.a (mon.0) 725 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: cluster 2021-01-27T13:40:28.969989+0000 mon.a (mon.0) 726 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:40:30.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: cluster 2021-01-27T13:40:28.970077+0000 mon.a (mon.0) 727 : cluster [INF] osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921] boot 2021-01-27T13:40:30.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: cluster 2021-01-27T13:40:28.970134+0000 mon.a (mon.0) 728 : cluster [INF] osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695] boot 2021-01-27T13:40:30.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: cluster 2021-01-27T13:40:28.970184+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T13:40:30.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: audit 2021-01-27T13:40:28.978714+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:40:30.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: audit 2021-01-27T13:40:28.979370+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:40:30.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[9724]: audit 2021-01-27T13:40:28.979784+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:40:30.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: cluster 2021-01-27T13:40:28.278040+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v388: 212 pgs: 18 undersized+peered, 40 active+undersized, 70 active+clean, 32 stale+active+clean, 2 undersized+degraded+peered+wait, 11 active+undersized+degraded+wait, 7 undersized+degraded+peered, 12 active+undersized+degraded, 11 active+undersized+wait, 9 undersized+peered+wait; 25 KiB data, 88 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 259/978 objects degraded (26.483%) 2021-01-27T13:40:30.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: cluster 2021-01-27T13:40:28.960618+0000 mon.a (mon.0) 725 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:30.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: cluster 2021-01-27T13:40:28.969989+0000 mon.a (mon.0) 726 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:40:30.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: cluster 2021-01-27T13:40:28.970077+0000 mon.a (mon.0) 727 : cluster [INF] osd.5 [v2:172.21.15.99:6808/1575468921,v1:172.21.15.99:6809/1575468921] boot 2021-01-27T13:40:30.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: cluster 2021-01-27T13:40:28.970134+0000 mon.a (mon.0) 728 : cluster [INF] osd.3 [v2:172.21.15.37:6826/4063867695,v1:172.21.15.37:6827/4063867695] boot 2021-01-27T13:40:30.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: cluster 2021-01-27T13:40:28.970184+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T13:40:30.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: audit 2021-01-27T13:40:28.978714+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T13:40:30.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: audit 2021-01-27T13:40:28.979370+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:40:30.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:29 smithi037 bash[13442]: audit 2021-01-27T13:40:28.979784+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T13:40:31.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:30 smithi099 bash[9889]: cluster 2021-01-27T13:40:29.969598+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T13:40:31.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:30 smithi099 bash[9889]: audit 2021-01-27T13:40:30.458240+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:31.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:30 smithi037 bash[13442]: cluster 2021-01-27T13:40:29.969598+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T13:40:31.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:30 smithi037 bash[13442]: audit 2021-01-27T13:40:30.458240+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:31.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:30 smithi037 bash[9724]: cluster 2021-01-27T13:40:29.969598+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T13:40:31.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:30 smithi037 bash[9724]: audit 2021-01-27T13:40:30.458240+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:31.999 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete ... ok 2021-01-27T13:40:32.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:32 smithi099 bash[9889]: cluster 2021-01-27T13:40:30.279652+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v391: 212 pgs: 29 active+clean+wait, 21 peering, 17 undersized+peered, 43 active+undersized, 66 active+clean, 4 stale+active+clean, 7 active+undersized+degraded+wait, 4 undersized+degraded+peered, 9 active+undersized+degraded, 9 active+undersized+wait, 3 undersized+peered+wait; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 127/978 objects degraded (12.986%) 2021-01-27T13:40:32.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:32 smithi099 bash[9889]: audit 2021-01-27T13:40:30.984111+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:32.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:32 smithi099 bash[9889]: cluster 2021-01-27T13:40:30.984318+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T13:40:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:31 smithi037 bash[9724]: cluster 2021-01-27T13:40:30.279652+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v391: 212 pgs: 29 active+clean+wait, 21 peering, 17 undersized+peered, 43 active+undersized, 66 active+clean, 4 stale+active+clean, 7 active+undersized+degraded+wait, 4 undersized+degraded+peered, 9 active+undersized+degraded, 9 active+undersized+wait, 3 undersized+peered+wait; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 127/978 objects degraded (12.986%) 2021-01-27T13:40:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:31 smithi037 bash[9724]: audit 2021-01-27T13:40:30.984111+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:32 smithi037 bash[9724]: cluster 2021-01-27T13:40:30.984318+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T13:40:32.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:32 smithi037 bash[13442]: cluster 2021-01-27T13:40:30.279652+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v391: 212 pgs: 29 active+clean+wait, 21 peering, 17 undersized+peered, 43 active+undersized, 66 active+clean, 4 stale+active+clean, 7 active+undersized+degraded+wait, 4 undersized+degraded+peered, 9 active+undersized+degraded, 9 active+undersized+wait, 3 undersized+peered+wait; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 127/978 objects degraded (12.986%) 2021-01-27T13:40:32.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:32 smithi037 bash[13442]: audit 2021-01-27T13:40:30.984111+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.37:0/2370209818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:32.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:32 smithi037 bash[13442]: cluster 2021-01-27T13:40:30.984318+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T13:40:33.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:33 smithi099 bash[9889]: cluster 2021-01-27T13:40:31.991155+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T13:40:33.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:33 smithi037 bash[9724]: cluster 2021-01-27T13:40:31.991155+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T13:40:33.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:33 smithi037 bash[13442]: cluster 2021-01-27T13:40:31.991155+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T13:40:34.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:34 smithi099 bash[9889]: cluster 2021-01-27T13:40:32.280676+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v394: 180 pgs: 35 active+clean+wait, 19 peering, 8 undersized+peered, 29 active+undersized, 80 active+clean, 2 undersized+degraded+peered, 7 active+undersized+degraded; 25 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/975 objects degraded (7.282%) 2021-01-27T13:40:34.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:34 smithi099 bash[9889]: cluster 2021-01-27T13:40:32.998805+0000 mon.a (mon.0) 738 : cluster [WRN] Health check update: Degraded data redundancy: 71/975 objects degraded (7.282%), 9 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:34.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:34 smithi099 bash[9889]: cluster 2021-01-27T13:40:32.998900+0000 mon.a (mon.0) 739 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive) 2021-01-27T13:40:34.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:34 smithi099 bash[9889]: cluster 2021-01-27T13:40:32.998949+0000 mon.a (mon.0) 740 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:34.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:34 smithi099 bash[9889]: cluster 2021-01-27T13:40:33.017571+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T13:40:34.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[9724]: cluster 2021-01-27T13:40:32.280676+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v394: 180 pgs: 35 active+clean+wait, 19 peering, 8 undersized+peered, 29 active+undersized, 80 active+clean, 2 undersized+degraded+peered, 7 active+undersized+degraded; 25 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/975 objects degraded (7.282%) 2021-01-27T13:40:34.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[9724]: cluster 2021-01-27T13:40:32.998805+0000 mon.a (mon.0) 738 : cluster [WRN] Health check update: Degraded data redundancy: 71/975 objects degraded (7.282%), 9 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:34.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[9724]: cluster 2021-01-27T13:40:32.998900+0000 mon.a (mon.0) 739 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive) 2021-01-27T13:40:34.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[9724]: cluster 2021-01-27T13:40:32.998949+0000 mon.a (mon.0) 740 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:34.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[9724]: cluster 2021-01-27T13:40:33.017571+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T13:40:34.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[13442]: cluster 2021-01-27T13:40:32.280676+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v394: 180 pgs: 35 active+clean+wait, 19 peering, 8 undersized+peered, 29 active+undersized, 80 active+clean, 2 undersized+degraded+peered, 7 active+undersized+degraded; 25 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 71/975 objects degraded (7.282%) 2021-01-27T13:40:34.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[13442]: cluster 2021-01-27T13:40:32.998805+0000 mon.a (mon.0) 738 : cluster [WRN] Health check update: Degraded data redundancy: 71/975 objects degraded (7.282%), 9 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:34.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[13442]: cluster 2021-01-27T13:40:32.998900+0000 mon.a (mon.0) 739 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive) 2021-01-27T13:40:34.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[13442]: cluster 2021-01-27T13:40:32.998949+0000 mon.a (mon.0) 740 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:34.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:34 smithi037 bash[13442]: cluster 2021-01-27T13:40:33.017571+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T13:40:35.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:35 smithi099 bash[9889]: cluster 2021-01-27T13:40:34.021731+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T13:40:35.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:35 smithi099 bash[9889]: audit 2021-01-27T13:40:34.063238+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T13:40:35.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:35 smithi099 bash[9889]: audit 2021-01-27T13:40:34.063761+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:35.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:35 smithi099 bash[9889]: audit 2021-01-27T13:40:34.064033+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:35.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[13442]: cluster 2021-01-27T13:40:34.021731+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T13:40:35.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[13442]: audit 2021-01-27T13:40:34.063238+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T13:40:35.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[13442]: audit 2021-01-27T13:40:34.063761+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:35.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[13442]: audit 2021-01-27T13:40:34.064033+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[9724]: debug 2021-01-27T13:40:35.044+0000 7ff30b0f8700 -1 mon.a@0(leader).osd e98 definitely_dead 0 2021-01-27T13:40:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[9724]: cluster 2021-01-27T13:40:34.021731+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T13:40:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[9724]: audit 2021-01-27T13:40:34.063238+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T13:40:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[9724]: audit 2021-01-27T13:40:34.063761+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:35 smithi037 bash[9724]: audit 2021-01-27T13:40:34.064033+0000 mon.a (mon.0) 743 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:36.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: cluster 2021-01-27T13:40:34.281867+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v397: 212 pgs: 10 creating+peering, 12 unknown, 35 active+clean+wait, 155 active+clean; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-01-27T13:40:36.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: cluster 2021-01-27T13:40:35.033171+0000 mon.a (mon.0) 744 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:36.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: cluster 2021-01-27T13:40:35.034011+0000 mon.a (mon.0) 745 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:36.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: cluster 2021-01-27T13:40:35.034059+0000 mon.a (mon.0) 746 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 71/975 objects degraded (7.282%), 9 pgs degraded) 2021-01-27T13:40:36.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: audit 2021-01-27T13:40:35.043769+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:36.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: cluster 2021-01-27T13:40:35.043958+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T13:40:36.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: audit 2021-01-27T13:40:35.047389+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T13:40:36.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: audit 2021-01-27T13:40:35.047993+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T13:40:36.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.037517+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:36.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: audit 2021-01-27T13:40:36.046344+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-27T13:40:36.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:36 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.046595+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-27T13:40:36.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: cluster 2021-01-27T13:40:34.281867+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v397: 212 pgs: 10 creating+peering, 12 unknown, 35 active+clean+wait, 155 active+clean; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-01-27T13:40:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: cluster 2021-01-27T13:40:35.033171+0000 mon.a (mon.0) 744 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: cluster 2021-01-27T13:40:35.034011+0000 mon.a (mon.0) 745 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:36.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: cluster 2021-01-27T13:40:35.034059+0000 mon.a (mon.0) 746 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 71/975 objects degraded (7.282%), 9 pgs degraded) 2021-01-27T13:40:36.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: audit 2021-01-27T13:40:35.043769+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:36.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: cluster 2021-01-27T13:40:35.043958+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T13:40:36.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: audit 2021-01-27T13:40:35.047389+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T13:40:36.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: audit 2021-01-27T13:40:35.047993+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T13:40:36.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.037517+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:36.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: audit 2021-01-27T13:40:36.046344+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-27T13:40:36.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.046595+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-27T13:40:36.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: cluster 2021-01-27T13:40:34.281867+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v397: 212 pgs: 10 creating+peering, 12 unknown, 35 active+clean+wait, 155 active+clean; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-01-27T13:40:36.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: cluster 2021-01-27T13:40:35.033171+0000 mon.a (mon.0) 744 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:36.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: cluster 2021-01-27T13:40:35.034011+0000 mon.a (mon.0) 745 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:40:36.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: cluster 2021-01-27T13:40:35.034059+0000 mon.a (mon.0) 746 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 71/975 objects degraded (7.282%), 9 pgs degraded) 2021-01-27T13:40:36.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: audit 2021-01-27T13:40:35.043769+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:36.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: cluster 2021-01-27T13:40:35.043958+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T13:40:36.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: audit 2021-01-27T13:40:35.047389+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T13:40:36.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: audit 2021-01-27T13:40:35.047993+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T13:40:36.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.037517+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:36.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: audit 2021-01-27T13:40:36.046344+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-27T13:40:36.329 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.046595+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-27T13:40:37.054 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:40:36 smithi037 bash[16533]: debug 2021-01-27T13:40:36.756+0000 7f7f47f62700 -1 osd.0 99 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:37.322 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[16533]: debug 2021-01-27T13:40:37.052+0000 7f7f384b7700 -1 osd.0 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:37.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.537872+0000 mon.a (mon.0) 753 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-27T13:40:37.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.634481+0000 mon.a (mon.0) 754 : cluster [INF] osd.2 marked itself dead as of e99 2021-01-27T13:40:37.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[13442]: cluster 2021-01-27T13:40:37.050030+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-27T13:40:37.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.537872+0000 mon.a (mon.0) 753 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-27T13:40:37.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.634481+0000 mon.a (mon.0) 754 : cluster [INF] osd.2 marked itself dead as of e99 2021-01-27T13:40:37.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[9724]: cluster 2021-01-27T13:40:37.050030+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-27T13:40:37.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:37 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.537872+0000 mon.a (mon.0) 753 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-27T13:40:37.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:37 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.634481+0000 mon.a (mon.0) 754 : cluster [INF] osd.2 marked itself dead as of e99 2021-01-27T13:40:37.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:37 smithi099 bash[9889]: cluster 2021-01-27T13:40:37.050030+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-27T13:40:37.823 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[21552]: debug 2021-01-27T13:40:37.672+0000 7f2a2bef6700 -1 osd.2 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:37.823 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[19026]: debug 2021-01-27T13:40:37.432+0000 7fe3d7a36700 -1 osd.1 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:38.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:40:37 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:40:38.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.283237+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v400: 212 pgs: 23 peering, 6 stale+creating+peering, 68 stale+active+clean, 3 creating+peering, 3 unknown, 35 active+clean+wait, 74 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T13:40:38.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.536648+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T13:40:38.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.536662+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T13:40:38.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.633694+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T13:40:38.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:36.633708+0000 osd.2 (osd.2) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T13:40:38.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:37.054979+0000 mon.a (mon.0) 756 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2021-01-27T13:40:38.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:37.099516+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-27T13:40:38.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:37.099523+0000 osd.1 (osd.1) 4 : cluster [DBG] map e100 wrongly marked me down at e99 2021-01-27T13:40:38.314 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:38 smithi099 bash[9889]: cluster 2021-01-27T13:40:37.100242+0000 mon.a (mon.0) 757 : cluster [INF] osd.1 marked itself dead as of e100 2021-01-27T13:40:38.323 INFO:journalctl@ceph.osd.1.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[19026]: debug 2021-01-27T13:40:38.084+0000 7fe3c878c700 -1 osd.1 101 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:38.324 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:40:37 smithi037 bash[9955]: debug 2021-01-27T13:40:37.904+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:40:38.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[21552]: debug 2021-01-27T13:40:38.076+0000 7f2a1dc4e700 -1 osd.2 101 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:38.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.283237+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v400: 212 pgs: 23 peering, 6 stale+creating+peering, 68 stale+active+clean, 3 creating+peering, 3 unknown, 35 active+clean+wait, 74 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T13:40:38.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.536648+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T13:40:38.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.536662+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T13:40:38.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.633694+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T13:40:38.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:36.633708+0000 osd.2 (osd.2) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T13:40:38.327 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:37.054979+0000 mon.a (mon.0) 756 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2021-01-27T13:40:38.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:37.099516+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-27T13:40:38.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:37.099523+0000 osd.1 (osd.1) 4 : cluster [DBG] map e100 wrongly marked me down at e99 2021-01-27T13:40:38.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[13442]: cluster 2021-01-27T13:40:37.100242+0000 mon.a (mon.0) 757 : cluster [INF] osd.1 marked itself dead as of e100 2021-01-27T13:40:38.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.283237+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v400: 212 pgs: 23 peering, 6 stale+creating+peering, 68 stale+active+clean, 3 creating+peering, 3 unknown, 35 active+clean+wait, 74 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T13:40:38.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.536648+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T13:40:38.330 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.536662+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T13:40:38.330 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.633694+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T13:40:38.330 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:36.633708+0000 osd.2 (osd.2) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T13:40:38.331 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:37.054979+0000 mon.a (mon.0) 756 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2021-01-27T13:40:38.331 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:37.099516+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-27T13:40:38.331 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:37.099523+0000 osd.1 (osd.1) 4 : cluster [DBG] map e100 wrongly marked me down at e99 2021-01-27T13:40:38.332 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[9724]: cluster 2021-01-27T13:40:37.100242+0000 mon.a (mon.0) 757 : cluster [INF] osd.1 marked itself dead as of e100 2021-01-27T13:40:38.332 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:40:38 smithi037 bash[16533]: debug 2021-01-27T13:40:38.076+0000 7f7f384b7700 -1 osd.0 101 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:39.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:39 smithi099 bash[9889]: audit 2021-01-27T13:40:37.905817+0000 mgr.y (mgr.14138) 504 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:39.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:39 smithi099 bash[9889]: cluster 2021-01-27T13:40:38.076500+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-27T13:40:39.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:39 smithi099 bash[9889]: audit 2021-01-27T13:40:39.052411+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:39.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:39 smithi099 bash[9889]: audit 2021-01-27T13:40:39.053168+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:39.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:39 smithi037 bash[9724]: audit 2021-01-27T13:40:37.905817+0000 mgr.y (mgr.14138) 504 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:39.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:39 smithi037 bash[9724]: cluster 2021-01-27T13:40:38.076500+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-27T13:40:39.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:39 smithi037 bash[9724]: audit 2021-01-27T13:40:39.052411+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:39.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:39 smithi037 bash[9724]: audit 2021-01-27T13:40:39.053168+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:39.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:39 smithi037 bash[13442]: audit 2021-01-27T13:40:37.905817+0000 mgr.y (mgr.14138) 504 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:39.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:39 smithi037 bash[13442]: cluster 2021-01-27T13:40:38.076500+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-27T13:40:39.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:39 smithi037 bash[13442]: audit 2021-01-27T13:40:39.052411+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:39.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:39 smithi037 bash[13442]: audit 2021-01-27T13:40:39.053168+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:40.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:40 smithi099 bash[9889]: cluster 2021-01-27T13:40:38.284731+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v403: 212 pgs: 3 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 4 undersized+peered, 13 active+undersized, 57 peering, 3 stale+creating+peering, 40 stale+active+clean, 26 active+clean+wait, 56 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14/978 objects degraded (1.431%) 2021-01-27T13:40:40.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:40 smithi099 bash[9889]: cluster 2021-01-27T13:40:39.073668+0000 mon.a (mon.0) 760 : cluster [WRN] Health check failed: Degraded data redundancy: 14/978 objects degraded (1.431%), 3 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:40.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:40 smithi099 bash[9889]: cluster 2021-01-27T13:40:39.940896+0000 mon.a (mon.0) 761 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:40.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:40 smithi099 bash[9889]: audit 2021-01-27T13:40:39.950648+0000 mon.a (mon.0) 762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:40.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:40 smithi099 bash[9889]: cluster 2021-01-27T13:40:39.950884+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e102: 8 total, 5 up, 8 in 2021-01-27T13:40:40.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[9724]: cluster 2021-01-27T13:40:38.284731+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v403: 212 pgs: 3 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 4 undersized+peered, 13 active+undersized, 57 peering, 3 stale+creating+peering, 40 stale+active+clean, 26 active+clean+wait, 56 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14/978 objects degraded (1.431%) 2021-01-27T13:40:40.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[9724]: cluster 2021-01-27T13:40:39.073668+0000 mon.a (mon.0) 760 : cluster [WRN] Health check failed: Degraded data redundancy: 14/978 objects degraded (1.431%), 3 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:40.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[9724]: cluster 2021-01-27T13:40:39.940896+0000 mon.a (mon.0) 761 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:40.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[9724]: audit 2021-01-27T13:40:39.950648+0000 mon.a (mon.0) 762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:40.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[9724]: cluster 2021-01-27T13:40:39.950884+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e102: 8 total, 5 up, 8 in 2021-01-27T13:40:40.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[13442]: cluster 2021-01-27T13:40:38.284731+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v403: 212 pgs: 3 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 4 undersized+peered, 13 active+undersized, 57 peering, 3 stale+creating+peering, 40 stale+active+clean, 26 active+clean+wait, 56 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 14/978 objects degraded (1.431%) 2021-01-27T13:40:40.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[13442]: cluster 2021-01-27T13:40:39.073668+0000 mon.a (mon.0) 760 : cluster [WRN] Health check failed: Degraded data redundancy: 14/978 objects degraded (1.431%), 3 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:40.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[13442]: cluster 2021-01-27T13:40:39.940896+0000 mon.a (mon.0) 761 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:40.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[13442]: audit 2021-01-27T13:40:39.950648+0000 mon.a (mon.0) 762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:40.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:40 smithi037 bash[13442]: cluster 2021-01-27T13:40:39.950884+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e102: 8 total, 5 up, 8 in 2021-01-27T13:40:41.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:41 smithi099 bash[9889]: cluster 2021-01-27T13:40:40.944479+0000 mon.a (mon.0) 764 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:41.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:41 smithi099 bash[9889]: cluster 2021-01-27T13:40:40.954204+0000 mon.a (mon.0) 765 : cluster [INF] osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624] boot 2021-01-27T13:40:41.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:41 smithi099 bash[9889]: cluster 2021-01-27T13:40:40.954405+0000 mon.a (mon.0) 766 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:40:41.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:41 smithi099 bash[9889]: cluster 2021-01-27T13:40:40.954570+0000 mon.a (mon.0) 767 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:40:41.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:41 smithi099 bash[9889]: cluster 2021-01-27T13:40:40.954712+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T13:40:41.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:41 smithi099 bash[9889]: audit 2021-01-27T13:40:40.962221+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:40:41.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:41 smithi099 bash[9889]: audit 2021-01-27T13:40:40.962985+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:40:41.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:41 smithi099 bash[9889]: audit 2021-01-27T13:40:40.971164+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:40:41.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[9724]: cluster 2021-01-27T13:40:40.944479+0000 mon.a (mon.0) 764 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:41.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[9724]: cluster 2021-01-27T13:40:40.954204+0000 mon.a (mon.0) 765 : cluster [INF] osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624] boot 2021-01-27T13:40:41.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[9724]: cluster 2021-01-27T13:40:40.954405+0000 mon.a (mon.0) 766 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:40:41.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[9724]: cluster 2021-01-27T13:40:40.954570+0000 mon.a (mon.0) 767 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:40:41.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[9724]: cluster 2021-01-27T13:40:40.954712+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T13:40:41.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[9724]: audit 2021-01-27T13:40:40.962221+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:40:41.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[9724]: audit 2021-01-27T13:40:40.962985+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:40:41.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[9724]: audit 2021-01-27T13:40:40.971164+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:40:41.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[13442]: cluster 2021-01-27T13:40:40.944479+0000 mon.a (mon.0) 764 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:41.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[13442]: cluster 2021-01-27T13:40:40.954204+0000 mon.a (mon.0) 765 : cluster [INF] osd.1 [v2:172.21.15.37:6810/2975719624,v1:172.21.15.37:6811/2975719624] boot 2021-01-27T13:40:41.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[13442]: cluster 2021-01-27T13:40:40.954405+0000 mon.a (mon.0) 766 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:40:41.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[13442]: cluster 2021-01-27T13:40:40.954570+0000 mon.a (mon.0) 767 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:40:41.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[13442]: cluster 2021-01-27T13:40:40.954712+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T13:40:41.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[13442]: audit 2021-01-27T13:40:40.962221+0000 mon.a (mon.0) 769 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:40:41.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[13442]: audit 2021-01-27T13:40:40.962985+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T13:40:41.576 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:41 smithi037 bash[13442]: audit 2021-01-27T13:40:40.971164+0000 mon.a (mon.0) 771 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:40:42.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:42 smithi099 bash[9889]: cluster 2021-01-27T13:40:40.286708+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v405: 212 pgs: 5 undersized+degraded+peered, 21 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 25 undersized+peered, 48 active+undersized, 57 peering, 7 stale+active+clean, 4 active+clean+wait, 35 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 230/978 objects degraded (23.517%) 2021-01-27T13:40:42.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:42 smithi099 bash[9889]: cluster 2021-01-27T13:40:41.956868+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T13:40:42.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:42 smithi099 bash[9889]: audit 2021-01-27T13:40:42.028780+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:42.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:42 smithi099 bash[9889]: audit 2021-01-27T13:40:42.029727+0000 mon.a (mon.0) 773 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:42.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:42 smithi037 bash[9724]: cluster 2021-01-27T13:40:40.286708+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v405: 212 pgs: 5 undersized+degraded+peered, 21 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 25 undersized+peered, 48 active+undersized, 57 peering, 7 stale+active+clean, 4 active+clean+wait, 35 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 230/978 objects degraded (23.517%) 2021-01-27T13:40:42.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:42 smithi037 bash[9724]: cluster 2021-01-27T13:40:41.956868+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T13:40:42.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:42 smithi037 bash[9724]: audit 2021-01-27T13:40:42.028780+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:42.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:42 smithi037 bash[9724]: audit 2021-01-27T13:40:42.029727+0000 mon.a (mon.0) 773 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:42.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:42 smithi037 bash[13442]: cluster 2021-01-27T13:40:40.286708+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v405: 212 pgs: 5 undersized+degraded+peered, 21 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 25 undersized+peered, 48 active+undersized, 57 peering, 7 stale+active+clean, 4 active+clean+wait, 35 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 230/978 objects degraded (23.517%) 2021-01-27T13:40:42.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:42 smithi037 bash[13442]: cluster 2021-01-27T13:40:41.956868+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T13:40:42.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:42 smithi037 bash[13442]: audit 2021-01-27T13:40:42.028780+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.37:0/2101281923' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:42.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:42 smithi037 bash[13442]: audit 2021-01-27T13:40:42.029727+0000 mon.a (mon.0) 773 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:43.970 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete_and_cb ... ok 2021-01-27T13:40:44.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:43 smithi099 bash[9889]: cluster 2021-01-27T13:40:42.288083+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v408: 212 pgs: 5 undersized+degraded+peered, 21 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 25 undersized+peered, 48 active+undersized, 57 peering, 7 stale+active+clean, 3 active+clean+wait, 36 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 230/978 objects degraded (23.517%) 2021-01-27T13:40:44.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:43 smithi099 bash[9889]: audit 2021-01-27T13:40:42.963499+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:44.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:43 smithi099 bash[9889]: cluster 2021-01-27T13:40:42.963638+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T13:40:44.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:43 smithi099 bash[9889]: cluster 2021-01-27T13:40:43.939164+0000 mon.a (mon.0) 776 : cluster [WRN] Health check update: Reduced data availability: 5 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2021-01-27T13:40:44.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:43 smithi037 bash[13442]: cluster 2021-01-27T13:40:42.288083+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v408: 212 pgs: 5 undersized+degraded+peered, 21 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 25 undersized+peered, 48 active+undersized, 57 peering, 7 stale+active+clean, 3 active+clean+wait, 36 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 230/978 objects degraded (23.517%) 2021-01-27T13:40:44.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:43 smithi037 bash[13442]: audit 2021-01-27T13:40:42.963499+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:44.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:43 smithi037 bash[13442]: cluster 2021-01-27T13:40:42.963638+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T13:40:44.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:43 smithi037 bash[13442]: cluster 2021-01-27T13:40:43.939164+0000 mon.a (mon.0) 776 : cluster [WRN] Health check update: Reduced data availability: 5 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2021-01-27T13:40:44.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:43 smithi037 bash[9724]: cluster 2021-01-27T13:40:42.288083+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v408: 212 pgs: 5 undersized+degraded+peered, 21 active+undersized+degraded, 4 active+undersized+wait, 6 undersized+peered+wait, 25 undersized+peered, 48 active+undersized, 57 peering, 7 stale+active+clean, 3 active+clean+wait, 36 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 230/978 objects degraded (23.517%) 2021-01-27T13:40:44.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:43 smithi037 bash[9724]: audit 2021-01-27T13:40:42.963499+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:44.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:43 smithi037 bash[9724]: cluster 2021-01-27T13:40:42.963638+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T13:40:44.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:43 smithi037 bash[9724]: cluster 2021-01-27T13:40:43.939164+0000 mon.a (mon.0) 776 : cluster [WRN] Health check update: Reduced data availability: 5 pgs inactive, 8 pgs peering (PG_AVAILABILITY) 2021-01-27T13:40:45.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:44 smithi099 bash[9889]: cluster 2021-01-27T13:40:43.961880+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T13:40:45.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:44 smithi037 bash[9724]: cluster 2021-01-27T13:40:43.961880+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T13:40:45.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:44 smithi037 bash[13442]: cluster 2021-01-27T13:40:43.961880+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T13:40:46.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:45 smithi099 bash[9889]: cluster 2021-01-27T13:40:44.289371+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v411: 180 pgs: 2 undersized+degraded+peered, 15 active+undersized+degraded, 5 undersized+peered, 17 active+undersized, 25 peering, 38 active+clean+wait, 78 active+clean; 25 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 68 op/s; 137/975 objects degraded (14.051%); 223 B/s, 2 objects/s recovering 2021-01-27T13:40:46.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:45 smithi099 bash[9889]: cluster 2021-01-27T13:40:44.974787+0000 mon.a (mon.0) 778 : cluster [WRN] Health check update: Degraded data redundancy: 137/975 objects degraded (14.051%), 17 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:46.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:45 smithi099 bash[9889]: cluster 2021-01-27T13:40:44.974878+0000 mon.a (mon.0) 779 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 8 pgs peering) 2021-01-27T13:40:46.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:45 smithi099 bash[9889]: cluster 2021-01-27T13:40:44.974955+0000 mon.a (mon.0) 780 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:46.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:45 smithi099 bash[9889]: cluster 2021-01-27T13:40:44.993143+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T13:40:46.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:45 smithi099 bash[9889]: audit 2021-01-27T13:40:45.006011+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-27T13:40:46.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:45 smithi099 bash[9889]: audit 2021-01-27T13:40:45.006827+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:46.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:45 smithi099 bash[9889]: audit 2021-01-27T13:40:45.007269+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:46.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[13442]: cluster 2021-01-27T13:40:44.289371+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v411: 180 pgs: 2 undersized+degraded+peered, 15 active+undersized+degraded, 5 undersized+peered, 17 active+undersized, 25 peering, 38 active+clean+wait, 78 active+clean; 25 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 68 op/s; 137/975 objects degraded (14.051%); 223 B/s, 2 objects/s recovering 2021-01-27T13:40:46.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[13442]: cluster 2021-01-27T13:40:44.974787+0000 mon.a (mon.0) 778 : cluster [WRN] Health check update: Degraded data redundancy: 137/975 objects degraded (14.051%), 17 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:46.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[13442]: cluster 2021-01-27T13:40:44.974878+0000 mon.a (mon.0) 779 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 8 pgs peering) 2021-01-27T13:40:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[13442]: cluster 2021-01-27T13:40:44.974955+0000 mon.a (mon.0) 780 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[13442]: cluster 2021-01-27T13:40:44.993143+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T13:40:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[13442]: audit 2021-01-27T13:40:45.006011+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-27T13:40:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[13442]: audit 2021-01-27T13:40:45.006827+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:46.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[13442]: audit 2021-01-27T13:40:45.007269+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:46.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[9724]: cluster 2021-01-27T13:40:44.289371+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v411: 180 pgs: 2 undersized+degraded+peered, 15 active+undersized+degraded, 5 undersized+peered, 17 active+undersized, 25 peering, 38 active+clean+wait, 78 active+clean; 25 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 68 op/s; 137/975 objects degraded (14.051%); 223 B/s, 2 objects/s recovering 2021-01-27T13:40:46.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[9724]: cluster 2021-01-27T13:40:44.974787+0000 mon.a (mon.0) 778 : cluster [WRN] Health check update: Degraded data redundancy: 137/975 objects degraded (14.051%), 17 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:46.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[9724]: cluster 2021-01-27T13:40:44.974878+0000 mon.a (mon.0) 779 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 8 pgs peering) 2021-01-27T13:40:46.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[9724]: cluster 2021-01-27T13:40:44.974955+0000 mon.a (mon.0) 780 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:40:46.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[9724]: cluster 2021-01-27T13:40:44.993143+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T13:40:46.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[9724]: audit 2021-01-27T13:40:45.006011+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-27T13:40:46.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[9724]: audit 2021-01-27T13:40:45.006827+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:46.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:45 smithi037 bash[9724]: audit 2021-01-27T13:40:45.007269+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T13:40:46.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:46 smithi037 bash[9724]: debug 2021-01-27T13:40:46.012+0000 7ff30b0f8700 -1 mon.a@0(leader).osd e108 definitely_dead 0 2021-01-27T13:40:47.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:46 smithi099 bash[9889]: cluster 2021-01-27T13:40:45.988010+0000 mon.a (mon.0) 783 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:47.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:46 smithi099 bash[9889]: audit 2021-01-27T13:40:46.008995+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:47.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:46 smithi099 bash[9889]: cluster 2021-01-27T13:40:46.009109+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-27T13:40:47.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:46 smithi099 bash[9889]: audit 2021-01-27T13:40:46.010852+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T13:40:47.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:46 smithi099 bash[9889]: audit 2021-01-27T13:40:46.014361+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T13:40:47.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:46 smithi037 bash[9724]: cluster 2021-01-27T13:40:45.988010+0000 mon.a (mon.0) 783 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:47.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:46 smithi037 bash[9724]: audit 2021-01-27T13:40:46.008995+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:47.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:46 smithi037 bash[9724]: cluster 2021-01-27T13:40:46.009109+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-27T13:40:47.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[9724]: audit 2021-01-27T13:40:46.010852+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T13:40:47.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[9724]: audit 2021-01-27T13:40:46.014361+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T13:40:47.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: cluster 2021-01-27T13:40:45.988010+0000 mon.a (mon.0) 783 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T13:40:47.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: audit 2021-01-27T13:40:46.008995+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T13:40:47.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: cluster 2021-01-27T13:40:46.009109+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-27T13:40:47.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: audit 2021-01-27T13:40:46.010852+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T13:40:47.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: audit 2021-01-27T13:40:46.014361+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T13:40:48.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:40:47 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:40:48.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:47 smithi099 bash[9889]: cluster 2021-01-27T13:40:46.290428+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v414: 212 pgs: 8 creating+peering, 19 unknown, 14 peering, 35 active+clean+wait, 136 active+clean; 25 KiB data, 102 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 68 op/s; 223 B/s, 2 objects/s recovering 2021-01-27T13:40:48.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:47 smithi099 bash[9889]: cluster 2021-01-27T13:40:47.003430+0000 mon.a (mon.0) 787 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:48.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:47 smithi099 bash[9889]: cluster 2021-01-27T13:40:47.003891+0000 mon.a (mon.0) 788 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 137/975 objects degraded (14.051%), 17 pgs degraded) 2021-01-27T13:40:48.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:47 smithi099 bash[9889]: audit 2021-01-27T13:40:47.010819+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-27T13:40:48.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:47 smithi099 bash[9889]: cluster 2021-01-27T13:40:47.010928+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-27T13:40:48.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[9955]: debug 2021-01-27T13:40:47.912+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:40:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[9724]: cluster 2021-01-27T13:40:46.290428+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v414: 212 pgs: 8 creating+peering, 19 unknown, 14 peering, 35 active+clean+wait, 136 active+clean; 25 KiB data, 102 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 68 op/s; 223 B/s, 2 objects/s recovering 2021-01-27T13:40:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[9724]: cluster 2021-01-27T13:40:47.003430+0000 mon.a (mon.0) 787 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[9724]: cluster 2021-01-27T13:40:47.003891+0000 mon.a (mon.0) 788 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 137/975 objects degraded (14.051%), 17 pgs degraded) 2021-01-27T13:40:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[9724]: audit 2021-01-27T13:40:47.010819+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-27T13:40:48.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[9724]: cluster 2021-01-27T13:40:47.010928+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-27T13:40:48.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: cluster 2021-01-27T13:40:46.290428+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v414: 212 pgs: 8 creating+peering, 19 unknown, 14 peering, 35 active+clean+wait, 136 active+clean; 25 KiB data, 102 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s rd, 68 op/s; 223 B/s, 2 objects/s recovering 2021-01-27T13:40:48.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: cluster 2021-01-27T13:40:47.003430+0000 mon.a (mon.0) 787 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T13:40:48.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: cluster 2021-01-27T13:40:47.003891+0000 mon.a (mon.0) 788 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 137/975 objects degraded (14.051%), 17 pgs degraded) 2021-01-27T13:40:48.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: audit 2021-01-27T13:40:47.010819+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-27T13:40:48.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:47 smithi037 bash[13442]: cluster 2021-01-27T13:40:47.010928+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-27T13:40:48.811 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:40:48 smithi099 bash[12776]: debug 2021-01-27T13:40:48.512+0000 7fa012777700 -1 osd.4 110 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:49.311 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:40:49 smithi099 bash[12776]: debug 2021-01-27T13:40:49.036+0000 7fa002ccc700 -1 osd.4 111 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:49.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:49 smithi099 bash[9889]: audit 2021-01-27T13:40:47.914025+0000 mgr.y (mgr.14138) 510 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:49.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:49 smithi099 bash[9889]: cluster 2021-01-27T13:40:48.024455+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-27T13:40:49.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:49 smithi099 bash[9889]: cluster 2021-01-27T13:40:48.287632+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T13:40:49.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:49 smithi099 bash[9889]: cluster 2021-01-27T13:40:48.287640+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-27T13:40:49.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:49 smithi099 bash[9889]: cluster 2021-01-27T13:40:48.288891+0000 mon.a (mon.0) 792 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-27T13:40:49.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[9724]: audit 2021-01-27T13:40:47.914025+0000 mgr.y (mgr.14138) 510 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:49.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[9724]: cluster 2021-01-27T13:40:48.024455+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-27T13:40:49.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[9724]: cluster 2021-01-27T13:40:48.287632+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T13:40:49.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[9724]: cluster 2021-01-27T13:40:48.287640+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-27T13:40:49.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[9724]: cluster 2021-01-27T13:40:48.288891+0000 mon.a (mon.0) 792 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-27T13:40:49.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[13442]: audit 2021-01-27T13:40:47.914025+0000 mgr.y (mgr.14138) 510 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:49.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[13442]: cluster 2021-01-27T13:40:48.024455+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-27T13:40:49.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[13442]: cluster 2021-01-27T13:40:48.287632+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T13:40:49.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[13442]: cluster 2021-01-27T13:40:48.287640+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-27T13:40:49.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[13442]: cluster 2021-01-27T13:40:48.288891+0000 mon.a (mon.0) 792 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-27T13:40:50.036 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:40:49 smithi037 bash[16533]: debug 2021-01-27T13:40:49.624+0000 7f7f4675f700 -1 osd.0 111 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:50.311 INFO:journalctl@ceph.osd.4.smithi099.stdout:Jan 27 13:40:50 smithi099 bash[12776]: debug 2021-01-27T13:40:50.040+0000 7fa002ccc700 -1 osd.4 112 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:50.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:50 smithi099 bash[9889]: cluster 2021-01-27T13:40:48.292643+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v417: 212 pgs: 22 undersized+peered+wait, 29 active+undersized+wait, 4 undersized+degraded+peered+wait, 11 active+undersized+degraded+wait, 5 stale+creating+peering, 14 stale+active+clean+wait, 28 stale+active+clean, 3 creating+peering, 7 unknown, 9 active+clean+wait, 80 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 124/975 objects degraded (12.718%) 2021-01-27T13:40:50.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:50 smithi099 bash[9889]: cluster 2021-01-27T13:40:49.020739+0000 mon.a (mon.0) 793 : cluster [WRN] Health check failed: Degraded data redundancy: 124/975 objects degraded (12.718%), 15 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:50.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:50 smithi099 bash[9889]: cluster 2021-01-27T13:40:49.037078+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-27T13:40:50.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:50 smithi099 bash[9889]: cluster 2021-01-27T13:40:49.069637+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T13:40:50.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:50 smithi099 bash[9889]: cluster 2021-01-27T13:40:49.069642+0000 osd.0 (osd.0) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-27T13:40:50.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:50 smithi099 bash[9889]: cluster 2021-01-27T13:40:49.071576+0000 mon.a (mon.0) 795 : cluster [INF] osd.0 marked itself dead as of e111 2021-01-27T13:40:50.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:50 smithi099 bash[9889]: cluster 2021-01-27T13:40:50.004310+0000 mon.a (mon.0) 796 : cluster [INF] osd.2 marked itself dead as of e111 2021-01-27T13:40:50.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[9724]: cluster 2021-01-27T13:40:48.292643+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v417: 212 pgs: 22 undersized+peered+wait, 29 active+undersized+wait, 4 undersized+degraded+peered+wait, 11 active+undersized+degraded+wait, 5 stale+creating+peering, 14 stale+active+clean+wait, 28 stale+active+clean, 3 creating+peering, 7 unknown, 9 active+clean+wait, 80 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 124/975 objects degraded (12.718%) 2021-01-27T13:40:50.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[9724]: cluster 2021-01-27T13:40:49.020739+0000 mon.a (mon.0) 793 : cluster [WRN] Health check failed: Degraded data redundancy: 124/975 objects degraded (12.718%), 15 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:50.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[9724]: cluster 2021-01-27T13:40:49.037078+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-27T13:40:50.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[9724]: cluster 2021-01-27T13:40:49.069637+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T13:40:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[9724]: cluster 2021-01-27T13:40:49.069642+0000 osd.0 (osd.0) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-27T13:40:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[9724]: cluster 2021-01-27T13:40:49.071576+0000 mon.a (mon.0) 795 : cluster [INF] osd.0 marked itself dead as of e111 2021-01-27T13:40:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[9724]: cluster 2021-01-27T13:40:50.004310+0000 mon.a (mon.0) 796 : cluster [INF] osd.2 marked itself dead as of e111 2021-01-27T13:40:50.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[13442]: cluster 2021-01-27T13:40:48.292643+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v417: 212 pgs: 22 undersized+peered+wait, 29 active+undersized+wait, 4 undersized+degraded+peered+wait, 11 active+undersized+degraded+wait, 5 stale+creating+peering, 14 stale+active+clean+wait, 28 stale+active+clean, 3 creating+peering, 7 unknown, 9 active+clean+wait, 80 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 124/975 objects degraded (12.718%) 2021-01-27T13:40:50.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[13442]: cluster 2021-01-27T13:40:49.020739+0000 mon.a (mon.0) 793 : cluster [WRN] Health check failed: Degraded data redundancy: 124/975 objects degraded (12.718%), 15 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:50.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[13442]: cluster 2021-01-27T13:40:49.037078+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-27T13:40:50.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[13442]: cluster 2021-01-27T13:40:49.069637+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T13:40:50.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[13442]: cluster 2021-01-27T13:40:49.069642+0000 osd.0 (osd.0) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-27T13:40:50.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[13442]: cluster 2021-01-27T13:40:49.071576+0000 mon.a (mon.0) 795 : cluster [INF] osd.0 marked itself dead as of e111 2021-01-27T13:40:50.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[13442]: cluster 2021-01-27T13:40:50.004310+0000 mon.a (mon.0) 796 : cluster [INF] osd.2 marked itself dead as of e111 2021-01-27T13:40:50.326 INFO:journalctl@ceph.osd.0.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[16533]: debug 2021-01-27T13:40:50.032+0000 7f7f384b7700 -1 osd.0 112 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:51.047 INFO:journalctl@ceph.osd.2.smithi037.stdout:Jan 27 13:40:50 smithi037 bash[21552]: debug 2021-01-27T13:40:50.636+0000 7f2a2a6f3700 -1 osd.2 112 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T13:40:51.048 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[9724]: cluster 2021-01-27T13:40:50.003627+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T13:40:51.048 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[9724]: cluster 2021-01-27T13:40:50.003636+0000 osd.2 (osd.2) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-27T13:40:51.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:51 smithi099 bash[9889]: cluster 2021-01-27T13:40:50.003627+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T13:40:51.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:51 smithi099 bash[9889]: cluster 2021-01-27T13:40:50.003636+0000 osd.2 (osd.2) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-27T13:40:51.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:51 smithi099 bash[9889]: audit 2021-01-27T13:40:50.030178+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:51.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:51 smithi099 bash[9889]: audit 2021-01-27T13:40:50.031506+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:51.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:51 smithi099 bash[9889]: cluster 2021-01-27T13:40:50.035634+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e112: 8 total, 5 up, 8 in 2021-01-27T13:40:51.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:51 smithi099 bash[9889]: cluster 2021-01-27T13:40:51.032773+0000 mon.a (mon.0) 799 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:51.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[9724]: audit 2021-01-27T13:40:50.030178+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:51.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[9724]: audit 2021-01-27T13:40:50.031506+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:51.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[9724]: cluster 2021-01-27T13:40:50.035634+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e112: 8 total, 5 up, 8 in 2021-01-27T13:40:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[9724]: cluster 2021-01-27T13:40:51.032773+0000 mon.a (mon.0) 799 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:51.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[13442]: cluster 2021-01-27T13:40:50.003627+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T13:40:51.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[13442]: cluster 2021-01-27T13:40:50.003636+0000 osd.2 (osd.2) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-27T13:40:51.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[13442]: audit 2021-01-27T13:40:50.030178+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:51.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[13442]: audit 2021-01-27T13:40:50.031506+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:51.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[13442]: cluster 2021-01-27T13:40:50.035634+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e112: 8 total, 5 up, 8 in 2021-01-27T13:40:51.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:51 smithi037 bash[13442]: cluster 2021-01-27T13:40:51.032773+0000 mon.a (mon.0) 799 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T13:40:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:52 smithi037 bash[9724]: cluster 2021-01-27T13:40:50.294118+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v420: 212 pgs: 5 active+undersized, 4 active+undersized+degraded, 33 undersized+peered+wait, 42 active+undersized+wait, 6 undersized+degraded+peered+wait, 16 active+undersized+degraded+wait, 5 stale+creating+peering, 6 stale+active+clean+wait, 21 stale+active+clean, 1 unknown, 9 active+clean+wait, 64 active+clean; 25 KiB data, 104 MiB used, 715 GiB / 715 GiB avail; 211/975 objects degraded (21.641%) 2021-01-27T13:40:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:52 smithi037 bash[9724]: audit 2021-01-27T13:40:51.043036+0000 mon.a (mon.0) 800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:52 smithi037 bash[9724]: cluster 2021-01-27T13:40:51.043243+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e113: 8 total, 5 up, 8 in 2021-01-27T13:40:52.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:52 smithi037 bash[13442]: cluster 2021-01-27T13:40:50.294118+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v420: 212 pgs: 5 active+undersized, 4 active+undersized+degraded, 33 undersized+peered+wait, 42 active+undersized+wait, 6 undersized+degraded+peered+wait, 16 active+undersized+degraded+wait, 5 stale+creating+peering, 6 stale+active+clean+wait, 21 stale+active+clean, 1 unknown, 9 active+clean+wait, 64 active+clean; 25 KiB data, 104 MiB used, 715 GiB / 715 GiB avail; 211/975 objects degraded (21.641%) 2021-01-27T13:40:52.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:52 smithi037 bash[13442]: audit 2021-01-27T13:40:51.043036+0000 mon.a (mon.0) 800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:52.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:52 smithi037 bash[13442]: cluster 2021-01-27T13:40:51.043243+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e113: 8 total, 5 up, 8 in 2021-01-27T13:40:52.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:52 smithi099 bash[9889]: cluster 2021-01-27T13:40:50.294118+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v420: 212 pgs: 5 active+undersized, 4 active+undersized+degraded, 33 undersized+peered+wait, 42 active+undersized+wait, 6 undersized+degraded+peered+wait, 16 active+undersized+degraded+wait, 5 stale+creating+peering, 6 stale+active+clean+wait, 21 stale+active+clean, 1 unknown, 9 active+clean+wait, 64 active+clean; 25 KiB data, 104 MiB used, 715 GiB / 715 GiB avail; 211/975 objects degraded (21.641%) 2021-01-27T13:40:52.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:52 smithi099 bash[9889]: audit 2021-01-27T13:40:51.043036+0000 mon.a (mon.0) 800 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:52.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:52 smithi099 bash[9889]: cluster 2021-01-27T13:40:51.043243+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e113: 8 total, 5 up, 8 in 2021-01-27T13:40:53.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: cluster 2021-01-27T13:40:52.048461+0000 mon.a (mon.0) 802 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:53.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: cluster 2021-01-27T13:40:52.058573+0000 mon.a (mon.0) 803 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:40:53.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: cluster 2021-01-27T13:40:52.058641+0000 mon.a (mon.0) 804 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:40:53.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: cluster 2021-01-27T13:40:52.058690+0000 mon.a (mon.0) 805 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:40:53.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: cluster 2021-01-27T13:40:52.058740+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T13:40:53.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: audit 2021-01-27T13:40:52.062647+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:40:53.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: audit 2021-01-27T13:40:52.063425+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:40:53.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: audit 2021-01-27T13:40:52.063951+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:40:53.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:53 smithi099 bash[9889]: cluster 2021-01-27T13:40:53.060902+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T13:40:53.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: cluster 2021-01-27T13:40:52.048461+0000 mon.a (mon.0) 802 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:53.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: cluster 2021-01-27T13:40:52.058573+0000 mon.a (mon.0) 803 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:40:53.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: cluster 2021-01-27T13:40:52.058641+0000 mon.a (mon.0) 804 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:40:53.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: cluster 2021-01-27T13:40:52.058690+0000 mon.a (mon.0) 805 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:40:53.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: cluster 2021-01-27T13:40:52.058740+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T13:40:53.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: audit 2021-01-27T13:40:52.062647+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:40:53.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: audit 2021-01-27T13:40:52.063425+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:40:53.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: audit 2021-01-27T13:40:52.063951+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:40:53.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[9724]: cluster 2021-01-27T13:40:53.060902+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T13:40:53.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: cluster 2021-01-27T13:40:52.048461+0000 mon.a (mon.0) 802 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T13:40:53.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: cluster 2021-01-27T13:40:52.058573+0000 mon.a (mon.0) 803 : cluster [INF] osd.4 [v2:172.21.15.99:6800/2470343434,v1:172.21.15.99:6801/2470343434] boot 2021-01-27T13:40:53.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: cluster 2021-01-27T13:40:52.058641+0000 mon.a (mon.0) 804 : cluster [INF] osd.0 [v2:172.21.15.37:6802/3717584473,v1:172.21.15.37:6803/3717584473] boot 2021-01-27T13:40:53.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: cluster 2021-01-27T13:40:52.058690+0000 mon.a (mon.0) 805 : cluster [INF] osd.2 [v2:172.21.15.37:6818/3212740438,v1:172.21.15.37:6819/3212740438] boot 2021-01-27T13:40:53.578 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: cluster 2021-01-27T13:40:52.058740+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T13:40:53.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: audit 2021-01-27T13:40:52.062647+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T13:40:53.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: audit 2021-01-27T13:40:52.063425+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T13:40:53.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: audit 2021-01-27T13:40:52.063951+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T13:40:53.579 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:53 smithi037 bash[13442]: cluster 2021-01-27T13:40:53.060902+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T13:40:54.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:54 smithi099 bash[9889]: cluster 2021-01-27T13:40:52.295392+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v423: 212 pgs: 8 undersized+peered, 41 active+undersized, 2 undersized+degraded+peered, 17 active+undersized+degraded, 33 undersized+peered+wait, 42 active+undersized+wait, 6 undersized+degraded+peered+wait, 16 active+undersized+degraded+wait, 5 stale+active+clean, 9 active+clean+wait, 33 active+clean; 25 KiB data, 105 MiB used, 715 GiB / 715 GiB avail; 298/975 objects degraded (30.564%) 2021-01-27T13:40:54.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:54 smithi099 bash[9889]: audit 2021-01-27T13:40:53.997323+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:54.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:54 smithi099 bash[9889]: audit 2021-01-27T13:40:53.998058+0000 mon.a (mon.0) 811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:54.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:54 smithi037 bash[13442]: cluster 2021-01-27T13:40:52.295392+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v423: 212 pgs: 8 undersized+peered, 41 active+undersized, 2 undersized+degraded+peered, 17 active+undersized+degraded, 33 undersized+peered+wait, 42 active+undersized+wait, 6 undersized+degraded+peered+wait, 16 active+undersized+degraded+wait, 5 stale+active+clean, 9 active+clean+wait, 33 active+clean; 25 KiB data, 105 MiB used, 715 GiB / 715 GiB avail; 298/975 objects degraded (30.564%) 2021-01-27T13:40:54.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:54 smithi037 bash[13442]: audit 2021-01-27T13:40:53.997323+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:54.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:54 smithi037 bash[13442]: audit 2021-01-27T13:40:53.998058+0000 mon.a (mon.0) 811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:54.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:54 smithi037 bash[9724]: cluster 2021-01-27T13:40:52.295392+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v423: 212 pgs: 8 undersized+peered, 41 active+undersized, 2 undersized+degraded+peered, 17 active+undersized+degraded, 33 undersized+peered+wait, 42 active+undersized+wait, 6 undersized+degraded+peered+wait, 16 active+undersized+degraded+wait, 5 stale+active+clean, 9 active+clean+wait, 33 active+clean; 25 KiB data, 105 MiB used, 715 GiB / 715 GiB avail; 298/975 objects degraded (30.564%) 2021-01-27T13:40:54.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:54 smithi037 bash[9724]: audit 2021-01-27T13:40:53.997323+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.37:0/1497770959' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:54.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:54 smithi037 bash[9724]: audit 2021-01-27T13:40:53.998058+0000 mon.a (mon.0) 811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:55.964 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete_and_cb_error ... ok 2021-01-27T13:40:56.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:55 smithi099 bash[9889]: cluster 2021-01-27T13:40:54.297257+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v425: 212 pgs: 4 undersized+peered, 36 active+undersized, 2 undersized+degraded+peered, 15 active+undersized+degraded, 5 undersized+peered+wait, 9 active+undersized+wait, 4 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 19 active+clean+wait, 115 active+clean; 25 KiB data, 106 MiB used, 715 GiB / 715 GiB avail; 179/975 objects degraded (18.359%) 2021-01-27T13:40:56.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:55 smithi099 bash[9889]: audit 2021-01-27T13:40:54.957633+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:56.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:55 smithi099 bash[9889]: cluster 2021-01-27T13:40:54.957765+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T13:40:56.313 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:55 smithi099 bash[9889]: cluster 2021-01-27T13:40:55.091286+0000 mon.a (mon.0) 814 : cluster [WRN] Health check update: Degraded data redundancy: 179/975 objects degraded (18.359%), 24 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:56.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:55 smithi037 bash[13442]: cluster 2021-01-27T13:40:54.297257+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v425: 212 pgs: 4 undersized+peered, 36 active+undersized, 2 undersized+degraded+peered, 15 active+undersized+degraded, 5 undersized+peered+wait, 9 active+undersized+wait, 4 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 19 active+clean+wait, 115 active+clean; 25 KiB data, 106 MiB used, 715 GiB / 715 GiB avail; 179/975 objects degraded (18.359%) 2021-01-27T13:40:56.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:55 smithi037 bash[13442]: audit 2021-01-27T13:40:54.957633+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:56.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:55 smithi037 bash[13442]: cluster 2021-01-27T13:40:54.957765+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T13:40:56.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:55 smithi037 bash[13442]: cluster 2021-01-27T13:40:55.091286+0000 mon.a (mon.0) 814 : cluster [WRN] Health check update: Degraded data redundancy: 179/975 objects degraded (18.359%), 24 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:56.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:55 smithi037 bash[9724]: cluster 2021-01-27T13:40:54.297257+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v425: 212 pgs: 4 undersized+peered, 36 active+undersized, 2 undersized+degraded+peered, 15 active+undersized+degraded, 5 undersized+peered+wait, 9 active+undersized+wait, 4 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 19 active+clean+wait, 115 active+clean; 25 KiB data, 106 MiB used, 715 GiB / 715 GiB avail; 179/975 objects degraded (18.359%) 2021-01-27T13:40:56.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:55 smithi037 bash[9724]: audit 2021-01-27T13:40:54.957633+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:40:56.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:55 smithi037 bash[9724]: cluster 2021-01-27T13:40:54.957765+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T13:40:56.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:55 smithi037 bash[9724]: cluster 2021-01-27T13:40:55.091286+0000 mon.a (mon.0) 814 : cluster [WRN] Health check update: Degraded data redundancy: 179/975 objects degraded (18.359%), 24 pgs degraded (PG_DEGRADED) 2021-01-27T13:40:57.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:56 smithi099 bash[9889]: cluster 2021-01-27T13:40:55.958280+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T13:40:57.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:56 smithi037 bash[9724]: cluster 2021-01-27T13:40:55.958280+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T13:40:57.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:56 smithi037 bash[13442]: cluster 2021-01-27T13:40:55.958280+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T13:40:58.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:57 smithi099 bash[9889]: cluster 2021-01-27T13:40:56.298274+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v428: 180 pgs: 1 undersized+peered, 9 active+undersized, 2 active+undersized+degraded, 28 active+clean+wait, 140 active+clean; 25 KiB data, 108 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s; 2/975 objects degraded (0.205%) 2021-01-27T13:40:58.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:57 smithi099 bash[9889]: cluster 2021-01-27T13:40:56.981070+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T13:40:58.312 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:40:57 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:40:58.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:57 smithi037 bash[9724]: cluster 2021-01-27T13:40:56.298274+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v428: 180 pgs: 1 undersized+peered, 9 active+undersized, 2 active+undersized+degraded, 28 active+clean+wait, 140 active+clean; 25 KiB data, 108 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s; 2/975 objects degraded (0.205%) 2021-01-27T13:40:58.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:57 smithi037 bash[9724]: cluster 2021-01-27T13:40:56.981070+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T13:40:58.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:40:57 smithi037 bash[9955]: debug 2021-01-27T13:40:57.912+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:40:58.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:57 smithi037 bash[13442]: cluster 2021-01-27T13:40:56.298274+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v428: 180 pgs: 1 undersized+peered, 9 active+undersized, 2 active+undersized+degraded, 28 active+clean+wait, 140 active+clean; 25 KiB data, 108 MiB used, 715 GiB / 715 GiB avail; 964 B/s rd, 0 op/s; 2/975 objects degraded (0.205%) 2021-01-27T13:40:58.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:57 smithi037 bash[13442]: cluster 2021-01-27T13:40:56.981070+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T13:40:59.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:59 smithi099 bash[9889]: audit 2021-01-27T13:40:57.917117+0000 mgr.y (mgr.14138) 516 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:59.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:59 smithi099 bash[9889]: cluster 2021-01-27T13:40:57.993278+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T13:40:59.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:59 smithi099 bash[9889]: audit 2021-01-27T13:40:58.061638+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.37:0/1097406064' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:59.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:40:59 smithi099 bash[9889]: audit 2021-01-27T13:40:58.062178+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:59.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:59 smithi037 bash[9724]: audit 2021-01-27T13:40:57.917117+0000 mgr.y (mgr.14138) 516 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:59.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:59 smithi037 bash[9724]: cluster 2021-01-27T13:40:57.993278+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T13:40:59.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:59 smithi037 bash[9724]: audit 2021-01-27T13:40:58.061638+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.37:0/1097406064' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:59.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:40:59 smithi037 bash[9724]: audit 2021-01-27T13:40:58.062178+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:59.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:59 smithi037 bash[13442]: audit 2021-01-27T13:40:57.917117+0000 mgr.y (mgr.14138) 516 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:40:59.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:59 smithi037 bash[13442]: cluster 2021-01-27T13:40:57.993278+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T13:40:59.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:59 smithi037 bash[13442]: audit 2021-01-27T13:40:58.061638+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.37:0/1097406064' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:40:59.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:40:59 smithi037 bash[13442]: audit 2021-01-27T13:40:58.062178+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:00.076 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_remove ... ok 2021-01-27T13:41:00.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:00 smithi099 bash[9889]: cluster 2021-01-27T13:40:58.299439+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v431: 212 pgs: 28 unknown, 28 active+clean+wait, 156 active+clean; 25 KiB data, 112 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T13:41:00.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:00 smithi099 bash[9889]: cluster 2021-01-27T13:40:58.990507+0000 mon.a (mon.0) 819 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/975 objects degraded (0.205%), 2 pgs degraded) 2021-01-27T13:41:00.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:00 smithi099 bash[9889]: cluster 2021-01-27T13:40:58.990574+0000 mon.a (mon.0) 820 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:00.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:00 smithi099 bash[9889]: audit 2021-01-27T13:40:58.998235+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:00.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:00 smithi099 bash[9889]: cluster 2021-01-27T13:40:58.998401+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T13:41:00.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[9724]: cluster 2021-01-27T13:40:58.299439+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v431: 212 pgs: 28 unknown, 28 active+clean+wait, 156 active+clean; 25 KiB data, 112 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T13:41:00.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[9724]: cluster 2021-01-27T13:40:58.990507+0000 mon.a (mon.0) 819 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/975 objects degraded (0.205%), 2 pgs degraded) 2021-01-27T13:41:00.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[9724]: cluster 2021-01-27T13:40:58.990574+0000 mon.a (mon.0) 820 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:00.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[9724]: audit 2021-01-27T13:40:58.998235+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:00.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[9724]: cluster 2021-01-27T13:40:58.998401+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T13:41:00.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[13442]: cluster 2021-01-27T13:40:58.299439+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v431: 212 pgs: 28 unknown, 28 active+clean+wait, 156 active+clean; 25 KiB data, 112 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T13:41:00.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[13442]: cluster 2021-01-27T13:40:58.990507+0000 mon.a (mon.0) 819 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/975 objects degraded (0.205%), 2 pgs degraded) 2021-01-27T13:41:00.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[13442]: cluster 2021-01-27T13:40:58.990574+0000 mon.a (mon.0) 820 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:00.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[13442]: audit 2021-01-27T13:40:58.998235+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:00.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:00 smithi037 bash[13442]: cluster 2021-01-27T13:40:58.998401+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T13:41:01.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:01 smithi037 bash[9724]: cluster 2021-01-27T13:41:00.013254+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T13:41:01.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:01 smithi037 bash[13442]: cluster 2021-01-27T13:41:00.013254+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T13:41:01.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:01 smithi099 bash[9889]: cluster 2021-01-27T13:41:00.013254+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T13:41:02.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:02 smithi099 bash[9889]: cluster 2021-01-27T13:41:00.300395+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v434: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:02.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:02 smithi099 bash[9889]: cluster 2021-01-27T13:41:01.072415+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T13:41:02.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:02 smithi037 bash[9724]: cluster 2021-01-27T13:41:00.300395+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v434: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:02.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:02 smithi037 bash[9724]: cluster 2021-01-27T13:41:01.072415+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T13:41:02.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:02 smithi037 bash[13442]: cluster 2021-01-27T13:41:00.300395+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v434: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 117 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:02.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:02 smithi037 bash[13442]: cluster 2021-01-27T13:41:01.072415+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T13:41:03.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:03 smithi099 bash[9889]: cluster 2021-01-27T13:41:02.075624+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T13:41:03.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:03 smithi099 bash[9889]: audit 2021-01-27T13:41:02.118632+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.37:0/1407375702' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:03.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:03 smithi099 bash[9889]: audit 2021-01-27T13:41:02.118990+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:03.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:03 smithi037 bash[9724]: cluster 2021-01-27T13:41:02.075624+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T13:41:03.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:03 smithi037 bash[9724]: audit 2021-01-27T13:41:02.118632+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.37:0/1407375702' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:03.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:03 smithi037 bash[9724]: audit 2021-01-27T13:41:02.118990+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:03 smithi037 bash[13442]: cluster 2021-01-27T13:41:02.075624+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T13:41:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:03 smithi037 bash[13442]: audit 2021-01-27T13:41:02.118632+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.37:0/1407375702' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:03.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:03 smithi037 bash[13442]: audit 2021-01-27T13:41:02.118990+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:04.112 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_rmxattr ... ok 2021-01-27T13:41:04.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:04 smithi099 bash[9889]: cluster 2021-01-27T13:41:02.301185+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v437: 212 pgs: 7 creating+peering, 25 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:04.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:04 smithi099 bash[9889]: audit 2021-01-27T13:41:03.097570+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:04.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:04 smithi099 bash[9889]: cluster 2021-01-27T13:41:03.097846+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T13:41:04.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:04 smithi037 bash[13442]: cluster 2021-01-27T13:41:02.301185+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v437: 212 pgs: 7 creating+peering, 25 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:04.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:04 smithi037 bash[13442]: audit 2021-01-27T13:41:03.097570+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:04.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:04 smithi037 bash[13442]: cluster 2021-01-27T13:41:03.097846+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T13:41:04.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:04 smithi037 bash[9724]: cluster 2021-01-27T13:41:02.301185+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v437: 212 pgs: 7 creating+peering, 25 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:04.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:04 smithi037 bash[9724]: audit 2021-01-27T13:41:03.097570+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:04.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:04 smithi037 bash[9724]: cluster 2021-01-27T13:41:03.097846+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T13:41:05.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:05 smithi099 bash[9889]: cluster 2021-01-27T13:41:04.103595+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T13:41:05.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:05 smithi037 bash[9724]: cluster 2021-01-27T13:41:04.103595+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T13:41:05.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:05 smithi037 bash[13442]: cluster 2021-01-27T13:41:04.103595+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T13:41:06.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:06 smithi099 bash[9889]: cluster 2021-01-27T13:41:04.302305+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v440: 180 pgs: 16 active+clean+wait, 164 active+clean; 25 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:06.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:06 smithi099 bash[9889]: cluster 2021-01-27T13:41:05.126831+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T13:41:06.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:06 smithi037 bash[9724]: cluster 2021-01-27T13:41:04.302305+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v440: 180 pgs: 16 active+clean+wait, 164 active+clean; 25 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:06.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:06 smithi037 bash[9724]: cluster 2021-01-27T13:41:05.126831+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T13:41:06.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:06 smithi037 bash[13442]: cluster 2021-01-27T13:41:04.302305+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v440: 180 pgs: 16 active+clean+wait, 164 active+clean; 25 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:06.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:06 smithi037 bash[13442]: cluster 2021-01-27T13:41:05.126831+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T13:41:07.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:07 smithi099 bash[9889]: cluster 2021-01-27T13:41:06.132352+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T13:41:07.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:07 smithi099 bash[9889]: audit 2021-01-27T13:41:06.172053+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.37:0/842658250' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:07.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:07 smithi099 bash[9889]: audit 2021-01-27T13:41:06.172396+0000 mon.a (mon.0) 832 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:07.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:07 smithi037 bash[9724]: cluster 2021-01-27T13:41:06.132352+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T13:41:07.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:07 smithi037 bash[9724]: audit 2021-01-27T13:41:06.172053+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.37:0/842658250' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:07.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:07 smithi037 bash[9724]: audit 2021-01-27T13:41:06.172396+0000 mon.a (mon.0) 832 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:07.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:07 smithi037 bash[13442]: cluster 2021-01-27T13:41:06.132352+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T13:41:07.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:07 smithi037 bash[13442]: audit 2021-01-27T13:41:06.172053+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.37:0/842658250' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:07.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:07 smithi037 bash[13442]: audit 2021-01-27T13:41:06.172396+0000 mon.a (mon.0) 832 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:08.168 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_setxattr ... ok 2021-01-27T13:41:08.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:08 smithi099 bash[9889]: cluster 2021-01-27T13:41:06.303250+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v443: 212 pgs: 7 creating+peering, 23 unknown, 4 active+clean+wait, 178 active+clean; 25 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:08.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:08 smithi099 bash[9889]: audit 2021-01-27T13:41:07.155455+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:08.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:08 smithi099 bash[9889]: cluster 2021-01-27T13:41:07.155596+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T13:41:08.312 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:41:07 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:41:08.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:41:07 smithi037 bash[9955]: debug 2021-01-27T13:41:07.924+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:41:08.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:08 smithi037 bash[9724]: cluster 2021-01-27T13:41:06.303250+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v443: 212 pgs: 7 creating+peering, 23 unknown, 4 active+clean+wait, 178 active+clean; 25 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:08.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:08 smithi037 bash[9724]: audit 2021-01-27T13:41:07.155455+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:08.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:08 smithi037 bash[9724]: cluster 2021-01-27T13:41:07.155596+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T13:41:08.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:08 smithi037 bash[13442]: cluster 2021-01-27T13:41:06.303250+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v443: 212 pgs: 7 creating+peering, 23 unknown, 4 active+clean+wait, 178 active+clean; 25 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:08.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:08 smithi037 bash[13442]: audit 2021-01-27T13:41:07.155455+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:08.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:08 smithi037 bash[13442]: cluster 2021-01-27T13:41:07.155596+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T13:41:09.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:09 smithi099 bash[9889]: audit 2021-01-27T13:41:07.928478+0000 mgr.y (mgr.14138) 522 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:09.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:09 smithi099 bash[9889]: cluster 2021-01-27T13:41:08.160497+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T13:41:09.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:09 smithi099 bash[9889]: cluster 2021-01-27T13:41:08.304300+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v446: 180 pgs: 4 active+clean+wait, 176 active+clean; 25 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:09.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:09 smithi037 bash[9724]: audit 2021-01-27T13:41:07.928478+0000 mgr.y (mgr.14138) 522 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:09.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:09 smithi037 bash[9724]: cluster 2021-01-27T13:41:08.160497+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T13:41:09.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:09 smithi037 bash[9724]: cluster 2021-01-27T13:41:08.304300+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v446: 180 pgs: 4 active+clean+wait, 176 active+clean; 25 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:09.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:09 smithi037 bash[13442]: audit 2021-01-27T13:41:07.928478+0000 mgr.y (mgr.14138) 522 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:09.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:09 smithi037 bash[13442]: cluster 2021-01-27T13:41:08.160497+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T13:41:09.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:09 smithi037 bash[13442]: cluster 2021-01-27T13:41:08.304300+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v446: 180 pgs: 4 active+clean+wait, 176 active+clean; 25 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:10.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:10 smithi099 bash[9889]: cluster 2021-01-27T13:41:09.181989+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T13:41:10.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:10 smithi037 bash[9724]: cluster 2021-01-27T13:41:09.181989+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T13:41:10.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:10 smithi037 bash[13442]: cluster 2021-01-27T13:41:09.181989+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T13:41:11.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:11 smithi099 bash[9889]: cluster 2021-01-27T13:41:10.188632+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T13:41:11.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:11 smithi099 bash[9889]: cluster 2021-01-27T13:41:10.305121+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v449: 212 pgs: 1 creating+activating, 24 unknown, 187 active+clean; 25 KiB data, 133 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:41:11.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:11 smithi099 bash[9889]: audit 2021-01-27T13:41:10.314251+0000 mon.a (mon.0) 838 : audit [INF] from='client.? 172.21.15.37:0/248624878' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:11.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:11 smithi037 bash[9724]: cluster 2021-01-27T13:41:10.188632+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T13:41:11.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:11 smithi037 bash[9724]: cluster 2021-01-27T13:41:10.305121+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v449: 212 pgs: 1 creating+activating, 24 unknown, 187 active+clean; 25 KiB data, 133 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:41:11.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:11 smithi037 bash[9724]: audit 2021-01-27T13:41:10.314251+0000 mon.a (mon.0) 838 : audit [INF] from='client.? 172.21.15.37:0/248624878' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:11.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:11 smithi037 bash[13442]: cluster 2021-01-27T13:41:10.188632+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T13:41:11.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:11 smithi037 bash[13442]: cluster 2021-01-27T13:41:10.305121+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v449: 212 pgs: 1 creating+activating, 24 unknown, 187 active+clean; 25 KiB data, 133 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:41:11.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:11 smithi037 bash[13442]: audit 2021-01-27T13:41:10.314251+0000 mon.a (mon.0) 838 : audit [INF] from='client.? 172.21.15.37:0/248624878' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:12.224 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_stat ... ok 2021-01-27T13:41:12.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:12 smithi099 bash[9889]: cluster 2021-01-27T13:41:11.195399+0000 mon.a (mon.0) 839 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:41:12.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:12 smithi099 bash[9889]: audit 2021-01-27T13:41:11.214046+0000 mon.a (mon.0) 840 : audit [INF] from='client.? 172.21.15.37:0/248624878' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:12.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:12 smithi099 bash[9889]: cluster 2021-01-27T13:41:11.214159+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T13:41:12.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:12 smithi037 bash[9724]: cluster 2021-01-27T13:41:11.195399+0000 mon.a (mon.0) 839 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:41:12.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:12 smithi037 bash[9724]: audit 2021-01-27T13:41:11.214046+0000 mon.a (mon.0) 840 : audit [INF] from='client.? 172.21.15.37:0/248624878' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:12.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:12 smithi037 bash[9724]: cluster 2021-01-27T13:41:11.214159+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T13:41:12.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:12 smithi037 bash[13442]: cluster 2021-01-27T13:41:11.195399+0000 mon.a (mon.0) 839 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:41:12.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:12 smithi037 bash[13442]: audit 2021-01-27T13:41:11.214046+0000 mon.a (mon.0) 840 : audit [INF] from='client.? 172.21.15.37:0/248624878' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:12.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:12 smithi037 bash[13442]: cluster 2021-01-27T13:41:11.214159+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T13:41:13.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:13 smithi099 bash[9889]: cluster 2021-01-27T13:41:12.217974+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T13:41:13.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:13 smithi099 bash[9889]: cluster 2021-01-27T13:41:12.305830+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v452: 180 pgs: 180 active+clean; 25 KiB data, 141 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:13.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:13 smithi037 bash[9724]: cluster 2021-01-27T13:41:12.217974+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T13:41:13.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:13 smithi037 bash[9724]: cluster 2021-01-27T13:41:12.305830+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v452: 180 pgs: 180 active+clean; 25 KiB data, 141 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:13.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:13 smithi037 bash[13442]: cluster 2021-01-27T13:41:12.217974+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T13:41:13.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:13 smithi037 bash[13442]: cluster 2021-01-27T13:41:12.305830+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v452: 180 pgs: 180 active+clean; 25 KiB data, 141 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:14.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:14 smithi099 bash[9889]: cluster 2021-01-27T13:41:13.223722+0000 mon.a (mon.0) 843 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:41:14.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:14 smithi099 bash[9889]: cluster 2021-01-27T13:41:13.223792+0000 mon.a (mon.0) 844 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:14.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:14 smithi099 bash[9889]: cluster 2021-01-27T13:41:13.243217+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T13:41:14.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:14 smithi037 bash[9724]: cluster 2021-01-27T13:41:13.223722+0000 mon.a (mon.0) 843 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:41:14.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:14 smithi037 bash[9724]: cluster 2021-01-27T13:41:13.223792+0000 mon.a (mon.0) 844 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:14.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:14 smithi037 bash[9724]: cluster 2021-01-27T13:41:13.243217+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T13:41:14.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:14 smithi037 bash[13442]: cluster 2021-01-27T13:41:13.223722+0000 mon.a (mon.0) 843 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:41:14.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:14 smithi037 bash[13442]: cluster 2021-01-27T13:41:13.223792+0000 mon.a (mon.0) 844 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:14.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:14 smithi037 bash[13442]: cluster 2021-01-27T13:41:13.243217+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T13:41:15.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:15 smithi099 bash[9889]: cluster 2021-01-27T13:41:14.240381+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T13:41:15.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:15 smithi099 bash[9889]: audit 2021-01-27T13:41:14.302395+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.37:0/1180863381' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:15.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:15 smithi099 bash[9889]: cluster 2021-01-27T13:41:14.306471+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v455: 212 pgs: 17 creating+peering, 15 unknown, 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-27T13:41:15.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:15 smithi099 bash[9889]: audit 2021-01-27T13:41:14.316408+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:41:15.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:15 smithi099 bash[9889]: audit 2021-01-27T13:41:14.316728+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:41:15.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[9724]: cluster 2021-01-27T13:41:14.240381+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T13:41:15.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[9724]: audit 2021-01-27T13:41:14.302395+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.37:0/1180863381' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:15.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[9724]: cluster 2021-01-27T13:41:14.306471+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v455: 212 pgs: 17 creating+peering, 15 unknown, 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-27T13:41:15.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[9724]: audit 2021-01-27T13:41:14.316408+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:41:15.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[9724]: audit 2021-01-27T13:41:14.316728+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:41:15.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[13442]: cluster 2021-01-27T13:41:14.240381+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T13:41:15.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[13442]: audit 2021-01-27T13:41:14.302395+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.37:0/1180863381' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:15.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[13442]: cluster 2021-01-27T13:41:14.306471+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v455: 212 pgs: 17 creating+peering, 15 unknown, 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-27T13:41:15.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[13442]: audit 2021-01-27T13:41:14.316408+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:41:15.575 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:15 smithi037 bash[13442]: audit 2021-01-27T13:41:14.316728+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:41:16.261 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_write ... ok 2021-01-27T13:41:16.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:16 smithi099 bash[9889]: audit 2021-01-27T13:41:15.254660+0000 mon.a (mon.0) 850 : audit [INF] from='client.? 172.21.15.37:0/1180863381' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:16.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:16 smithi099 bash[9889]: cluster 2021-01-27T13:41:15.254829+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T13:41:16.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:16 smithi037 bash[9724]: audit 2021-01-27T13:41:15.254660+0000 mon.a (mon.0) 850 : audit [INF] from='client.? 172.21.15.37:0/1180863381' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:16.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:16 smithi037 bash[9724]: cluster 2021-01-27T13:41:15.254829+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T13:41:16.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:16 smithi037 bash[13442]: audit 2021-01-27T13:41:15.254660+0000 mon.a (mon.0) 850 : audit [INF] from='client.? 172.21.15.37:0/1180863381' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:16.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:16 smithi037 bash[13442]: cluster 2021-01-27T13:41:15.254829+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T13:41:17.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:17 smithi099 bash[9889]: cluster 2021-01-27T13:41:16.255890+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T13:41:17.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:17 smithi099 bash[9889]: cluster 2021-01-27T13:41:16.307056+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v458: 180 pgs: 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:17.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:17 smithi037 bash[9724]: cluster 2021-01-27T13:41:16.255890+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T13:41:17.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:17 smithi037 bash[9724]: cluster 2021-01-27T13:41:16.307056+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v458: 180 pgs: 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:17.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:17 smithi037 bash[13442]: cluster 2021-01-27T13:41:16.255890+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T13:41:17.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:17 smithi037 bash[13442]: cluster 2021-01-27T13:41:16.307056+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v458: 180 pgs: 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:18.277 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:41:17 smithi037 bash[9955]: debug 2021-01-27T13:41:17.927+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:41:18.277 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:41:17 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:41:18.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:18 smithi099 bash[9889]: cluster 2021-01-27T13:41:17.280395+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T13:41:18.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:18 smithi099 bash[9889]: audit 2021-01-27T13:41:17.930626+0000 mgr.y (mgr.14138) 528 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:18.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:18 smithi037 bash[9724]: cluster 2021-01-27T13:41:17.280395+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T13:41:18.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:18 smithi037 bash[9724]: audit 2021-01-27T13:41:17.930626+0000 mgr.y (mgr.14138) 528 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:18.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:18 smithi037 bash[13442]: cluster 2021-01-27T13:41:17.280395+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T13:41:18.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:18 smithi037 bash[13442]: audit 2021-01-27T13:41:17.930626+0000 mgr.y (mgr.14138) 528 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:19.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:19 smithi099 bash[9889]: cluster 2021-01-27T13:41:18.290874+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T13:41:19.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:19 smithi099 bash[9889]: cluster 2021-01-27T13:41:18.307730+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v461: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 144 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:19.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:19 smithi099 bash[9889]: audit 2021-01-27T13:41:18.355179+0000 mon.a (mon.0) 855 : audit [INF] from='client.? 172.21.15.37:0/2357432538' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:19.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:19 smithi037 bash[9724]: cluster 2021-01-27T13:41:18.290874+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T13:41:19.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:19 smithi037 bash[9724]: cluster 2021-01-27T13:41:18.307730+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v461: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 144 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:19.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:19 smithi037 bash[9724]: audit 2021-01-27T13:41:18.355179+0000 mon.a (mon.0) 855 : audit [INF] from='client.? 172.21.15.37:0/2357432538' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:19.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:19 smithi037 bash[13442]: cluster 2021-01-27T13:41:18.290874+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T13:41:19.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:19 smithi037 bash[13442]: cluster 2021-01-27T13:41:18.307730+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v461: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 144 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:19.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:19 smithi037 bash[13442]: audit 2021-01-27T13:41:18.355179+0000 mon.a (mon.0) 855 : audit [INF] from='client.? 172.21.15.37:0/2357432538' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:20.313 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_write_full ... ok 2021-01-27T13:41:20.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:20 smithi099 bash[9889]: audit 2021-01-27T13:41:19.300403+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.37:0/2357432538' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:20.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:20 smithi099 bash[9889]: cluster 2021-01-27T13:41:19.300698+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T13:41:20.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:20 smithi037 bash[9724]: audit 2021-01-27T13:41:19.300403+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.37:0/2357432538' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:20.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:20 smithi037 bash[9724]: cluster 2021-01-27T13:41:19.300698+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T13:41:20.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:20 smithi037 bash[13442]: audit 2021-01-27T13:41:19.300403+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.37:0/2357432538' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:20.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:20 smithi037 bash[13442]: cluster 2021-01-27T13:41:19.300698+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T13:41:21.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:21 smithi037 bash[9724]: cluster 2021-01-27T13:41:20.308260+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v464: 180 pgs: 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:21.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:21 smithi037 bash[9724]: cluster 2021-01-27T13:41:20.308788+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T13:41:21.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:21 smithi037 bash[13442]: cluster 2021-01-27T13:41:20.308260+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v464: 180 pgs: 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:21.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:21 smithi037 bash[13442]: cluster 2021-01-27T13:41:20.308788+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T13:41:21.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:21 smithi099 bash[9889]: cluster 2021-01-27T13:41:20.308260+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v464: 180 pgs: 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:21.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:21 smithi099 bash[9889]: cluster 2021-01-27T13:41:20.308788+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T13:41:22.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:22 smithi099 bash[9889]: cluster 2021-01-27T13:41:21.325157+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T13:41:22.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:22 smithi037 bash[9724]: cluster 2021-01-27T13:41:21.325157+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T13:41:22.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:22 smithi037 bash[13442]: cluster 2021-01-27T13:41:21.325157+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T13:41:23.817 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:23 smithi099 bash[9889]: cluster 2021-01-27T13:41:22.309223+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v466: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:23.818 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:23 smithi099 bash[9889]: cluster 2021-01-27T13:41:22.327817+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T13:41:23.818 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:23 smithi099 bash[9889]: audit 2021-01-27T13:41:22.399476+0000 mon.a (mon.0) 861 : audit [INF] from='client.? 172.21.15.37:0/3419162142' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:23.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:23 smithi037 bash[9724]: cluster 2021-01-27T13:41:22.309223+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v466: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:23.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:23 smithi037 bash[9724]: cluster 2021-01-27T13:41:22.327817+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T13:41:23.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:23 smithi037 bash[9724]: audit 2021-01-27T13:41:22.399476+0000 mon.a (mon.0) 861 : audit [INF] from='client.? 172.21.15.37:0/3419162142' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:23.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:23 smithi037 bash[13442]: cluster 2021-01-27T13:41:22.309223+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v466: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:23.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:23 smithi037 bash[13442]: cluster 2021-01-27T13:41:22.327817+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T13:41:23.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:23 smithi037 bash[13442]: audit 2021-01-27T13:41:22.399476+0000 mon.a (mon.0) 861 : audit [INF] from='client.? 172.21.15.37:0/3419162142' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:24.369 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_write_no_comp_ref ... ok 2021-01-27T13:41:24.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:24 smithi099 bash[9889]: audit 2021-01-27T13:41:23.353311+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.37:0/3419162142' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:24.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:24 smithi099 bash[9889]: cluster 2021-01-27T13:41:23.353465+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T13:41:24.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:24 smithi037 bash[9724]: audit 2021-01-27T13:41:23.353311+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.37:0/3419162142' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:24.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:24 smithi037 bash[9724]: cluster 2021-01-27T13:41:23.353465+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T13:41:24.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:24 smithi037 bash[13442]: audit 2021-01-27T13:41:23.353311+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.37:0/3419162142' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:24.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:24 smithi037 bash[13442]: cluster 2021-01-27T13:41:23.353465+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T13:41:25.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:25 smithi099 bash[9889]: cluster 2021-01-27T13:41:24.310256+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v469: 212 pgs: 4 creating+peering, 12 unknown, 196 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:25.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:25 smithi099 bash[9889]: cluster 2021-01-27T13:41:24.361831+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T13:41:25.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:25 smithi037 bash[9724]: cluster 2021-01-27T13:41:24.310256+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v469: 212 pgs: 4 creating+peering, 12 unknown, 196 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:25.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:25 smithi037 bash[9724]: cluster 2021-01-27T13:41:24.361831+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T13:41:25.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:25 smithi037 bash[13442]: cluster 2021-01-27T13:41:24.310256+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v469: 212 pgs: 4 creating+peering, 12 unknown, 196 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:25.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:25 smithi037 bash[13442]: cluster 2021-01-27T13:41:24.361831+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T13:41:26.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:26 smithi099 bash[9889]: cluster 2021-01-27T13:41:25.395274+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T13:41:26.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:26 smithi037 bash[9724]: cluster 2021-01-27T13:41:25.395274+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T13:41:26.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:26 smithi037 bash[13442]: cluster 2021-01-27T13:41:25.395274+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T13:41:27.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:27 smithi099 bash[9889]: cluster 2021-01-27T13:41:26.311283+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v472: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:27.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:27 smithi099 bash[9889]: cluster 2021-01-27T13:41:26.398543+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T13:41:27.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:27 smithi099 bash[9889]: audit 2021-01-27T13:41:26.580370+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.37:0/4269612123' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:27.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:27 smithi037 bash[9724]: cluster 2021-01-27T13:41:26.311283+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v472: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:27.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:27 smithi037 bash[9724]: cluster 2021-01-27T13:41:26.398543+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T13:41:27.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:27 smithi037 bash[9724]: audit 2021-01-27T13:41:26.580370+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.37:0/4269612123' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:27.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:27 smithi037 bash[13442]: cluster 2021-01-27T13:41:26.311283+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v472: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:27.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:27 smithi037 bash[13442]: cluster 2021-01-27T13:41:26.398543+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T13:41:27.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:27 smithi037 bash[13442]: audit 2021-01-27T13:41:26.580370+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.37:0/4269612123' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:28.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:41:27 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:41:28.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:41:27 smithi037 bash[9955]: debug 2021-01-27T13:41:27.935+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:41:28.433 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_aio_writesame ... ok 2021-01-27T13:41:28.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:28 smithi099 bash[9889]: audit 2021-01-27T13:41:27.423499+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.37:0/4269612123' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:28.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:28 smithi099 bash[9889]: cluster 2021-01-27T13:41:27.423924+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T13:41:28.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:28 smithi099 bash[9889]: audit 2021-01-27T13:41:27.939353+0000 mgr.y (mgr.14138) 534 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:28.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:28 smithi037 bash[9724]: audit 2021-01-27T13:41:27.423499+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.37:0/4269612123' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:28.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:28 smithi037 bash[9724]: cluster 2021-01-27T13:41:27.423924+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T13:41:28.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:28 smithi037 bash[9724]: audit 2021-01-27T13:41:27.939353+0000 mgr.y (mgr.14138) 534 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:28.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:28 smithi037 bash[13442]: audit 2021-01-27T13:41:27.423499+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.37:0/4269612123' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:28.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:28 smithi037 bash[13442]: cluster 2021-01-27T13:41:27.423924+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T13:41:28.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:28 smithi037 bash[13442]: audit 2021-01-27T13:41:27.939353+0000 mgr.y (mgr.14138) 534 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:29.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:29 smithi099 bash[9889]: cluster 2021-01-27T13:41:28.312472+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v475: 212 pgs: 22 unknown, 190 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:29.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:29 smithi099 bash[9889]: cluster 2021-01-27T13:41:28.428162+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T13:41:29.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:29 smithi037 bash[13442]: cluster 2021-01-27T13:41:28.312472+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v475: 212 pgs: 22 unknown, 190 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:29.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:29 smithi037 bash[13442]: cluster 2021-01-27T13:41:28.428162+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T13:41:29.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:29 smithi037 bash[9724]: cluster 2021-01-27T13:41:28.312472+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v475: 212 pgs: 22 unknown, 190 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:29.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:29 smithi037 bash[9724]: cluster 2021-01-27T13:41:28.428162+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T13:41:30.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:30 smithi099 bash[9889]: cluster 2021-01-27T13:41:29.449740+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T13:41:30.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:30 smithi099 bash[9889]: audit 2021-01-27T13:41:29.458689+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.37:0/223859319' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:30.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:30 smithi037 bash[9724]: cluster 2021-01-27T13:41:29.449740+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T13:41:30.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:30 smithi037 bash[9724]: audit 2021-01-27T13:41:29.458689+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.37:0/223859319' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:30.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:30 smithi037 bash[13442]: cluster 2021-01-27T13:41:29.449740+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T13:41:30.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:30 smithi037 bash[13442]: audit 2021-01-27T13:41:29.458689+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.37:0/223859319' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:31.465 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_alignment ... ok 2021-01-27T13:41:31.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:31 smithi099 bash[9889]: cluster 2021-01-27T13:41:30.313698+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v478: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:31.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:31 smithi099 bash[9889]: audit 2021-01-27T13:41:30.458872+0000 mon.a (mon.0) 873 : audit [INF] from='client.? 172.21.15.37:0/223859319' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:31.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:31 smithi099 bash[9889]: cluster 2021-01-27T13:41:30.459899+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T13:41:31.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:31 smithi099 bash[9889]: cluster 2021-01-27T13:41:31.462891+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T13:41:31.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:31 smithi037 bash[9724]: cluster 2021-01-27T13:41:30.313698+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v478: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:31.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:31 smithi037 bash[9724]: audit 2021-01-27T13:41:30.458872+0000 mon.a (mon.0) 873 : audit [INF] from='client.? 172.21.15.37:0/223859319' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:31.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:31 smithi037 bash[9724]: cluster 2021-01-27T13:41:30.459899+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T13:41:31.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:31 smithi037 bash[9724]: cluster 2021-01-27T13:41:31.462891+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T13:41:31.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:31 smithi037 bash[13442]: cluster 2021-01-27T13:41:30.313698+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v478: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:31.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:31 smithi037 bash[13442]: audit 2021-01-27T13:41:30.458872+0000 mon.a (mon.0) 873 : audit [INF] from='client.? 172.21.15.37:0/223859319' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:31.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:31 smithi037 bash[13442]: cluster 2021-01-27T13:41:30.459899+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T13:41:31.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:31 smithi037 bash[13442]: cluster 2021-01-27T13:41:31.462891+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T13:41:33.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:33 smithi099 bash[9889]: cluster 2021-01-27T13:41:32.314638+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v481: 180 pgs: 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:33.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:33 smithi099 bash[9889]: cluster 2021-01-27T13:41:32.484504+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T13:41:33.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:33 smithi037 bash[9724]: cluster 2021-01-27T13:41:32.314638+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v481: 180 pgs: 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:33.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:33 smithi037 bash[9724]: cluster 2021-01-27T13:41:32.484504+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T13:41:33.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:33 smithi037 bash[13442]: cluster 2021-01-27T13:41:32.314638+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v481: 180 pgs: 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:33.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:33 smithi037 bash[13442]: cluster 2021-01-27T13:41:32.484504+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T13:41:34.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:34 smithi099 bash[9889]: cluster 2021-01-27T13:41:33.490672+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T13:41:34.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:34 smithi099 bash[9889]: audit 2021-01-27T13:41:33.529079+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.37:0/3666106046' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:34.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:34 smithi099 bash[9889]: audit 2021-01-27T13:41:33.529494+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:34.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:34 smithi037 bash[9724]: cluster 2021-01-27T13:41:33.490672+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T13:41:34.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:34 smithi037 bash[9724]: audit 2021-01-27T13:41:33.529079+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.37:0/3666106046' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:34.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:34 smithi037 bash[9724]: audit 2021-01-27T13:41:33.529494+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:34.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:34 smithi037 bash[13442]: cluster 2021-01-27T13:41:33.490672+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T13:41:34.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:34 smithi037 bash[13442]: audit 2021-01-27T13:41:33.529079+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.37:0/3666106046' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:34.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:34 smithi037 bash[13442]: audit 2021-01-27T13:41:33.529494+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:35.540 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_append ... ok 2021-01-27T13:41:35.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:35 smithi099 bash[9889]: cluster 2021-01-27T13:41:34.315655+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v484: 212 pgs: 7 creating+peering, 17 unknown, 188 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:35.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:35 smithi099 bash[9889]: audit 2021-01-27T13:41:34.515529+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:35.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:35 smithi099 bash[9889]: cluster 2021-01-27T13:41:34.515645+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T13:41:35.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:35 smithi037 bash[9724]: cluster 2021-01-27T13:41:34.315655+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v484: 212 pgs: 7 creating+peering, 17 unknown, 188 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:35.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:35 smithi037 bash[9724]: audit 2021-01-27T13:41:34.515529+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:35.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:35 smithi037 bash[9724]: cluster 2021-01-27T13:41:34.515645+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T13:41:35.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:35 smithi037 bash[13442]: cluster 2021-01-27T13:41:34.315655+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v484: 212 pgs: 7 creating+peering, 17 unknown, 188 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:35.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:35 smithi037 bash[13442]: audit 2021-01-27T13:41:34.515529+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:35.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:35 smithi037 bash[13442]: cluster 2021-01-27T13:41:34.515645+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T13:41:36.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:36 smithi099 bash[9889]: cluster 2021-01-27T13:41:35.529191+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T13:41:36.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:36 smithi037 bash[9724]: cluster 2021-01-27T13:41:35.529191+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T13:41:36.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:36 smithi037 bash[13442]: cluster 2021-01-27T13:41:35.529191+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T13:41:37.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:37 smithi099 bash[9889]: cluster 2021-01-27T13:41:36.316632+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v487: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:37.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:37 smithi099 bash[9889]: cluster 2021-01-27T13:41:36.539608+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T13:41:37.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:37 smithi099 bash[9889]: audit 2021-01-27T13:41:36.546264+0000 mon.a (mon.0) 883 : audit [DBG] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:41:37.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:37 smithi099 bash[9889]: audit 2021-01-27T13:41:36.548967+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T13:41:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[9724]: cluster 2021-01-27T13:41:36.316632+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v487: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[9724]: cluster 2021-01-27T13:41:36.539608+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T13:41:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[9724]: audit 2021-01-27T13:41:36.546264+0000 mon.a (mon.0) 883 : audit [DBG] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:41:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[9724]: audit 2021-01-27T13:41:36.548967+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T13:41:37.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[13442]: cluster 2021-01-27T13:41:36.316632+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v487: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:37.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[13442]: cluster 2021-01-27T13:41:36.539608+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T13:41:37.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[13442]: audit 2021-01-27T13:41:36.546264+0000 mon.a (mon.0) 883 : audit [DBG] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T13:41:37.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[13442]: audit 2021-01-27T13:41:36.548967+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T13:41:38.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:41:37 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:41:38.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:41:37 smithi037 bash[9955]: debug 2021-01-27T13:41:37.947+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:41:38.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:38 smithi099 bash[9889]: audit 2021-01-27T13:41:37.545551+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-27T13:41:38.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:38 smithi099 bash[9889]: cluster 2021-01-27T13:41:37.545755+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T13:41:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:38 smithi099 bash[9889]: audit 2021-01-27T13:41:37.548974+0000 mon.a (mon.0) 887 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-27T13:41:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:38 smithi099 bash[9889]: audit 2021-01-27T13:41:37.549739+0000 mon.a (mon.0) 888 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T13:41:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:38 smithi099 bash[9889]: audit 2021-01-27T13:41:37.950577+0000 mgr.y (mgr.14138) 540 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:38 smithi099 bash[9889]: audit 2021-01-27T13:41:38.551818+0000 mon.a (mon.0) 889 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T13:41:38.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:38 smithi099 bash[9889]: cluster 2021-01-27T13:41:38.551941+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T13:41:38.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[9724]: audit 2021-01-27T13:41:37.545551+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-27T13:41:38.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[9724]: cluster 2021-01-27T13:41:37.545755+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T13:41:38.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[9724]: audit 2021-01-27T13:41:37.548974+0000 mon.a (mon.0) 887 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-27T13:41:38.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[9724]: audit 2021-01-27T13:41:37.549739+0000 mon.a (mon.0) 888 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T13:41:38.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[9724]: audit 2021-01-27T13:41:37.950577+0000 mgr.y (mgr.14138) 540 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:38.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[9724]: audit 2021-01-27T13:41:38.551818+0000 mon.a (mon.0) 889 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T13:41:38.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[9724]: cluster 2021-01-27T13:41:38.551941+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T13:41:38.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[13442]: audit 2021-01-27T13:41:37.545551+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-27T13:41:38.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[13442]: cluster 2021-01-27T13:41:37.545755+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T13:41:38.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[13442]: audit 2021-01-27T13:41:37.548974+0000 mon.a (mon.0) 887 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-27T13:41:38.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[13442]: audit 2021-01-27T13:41:37.549739+0000 mon.a (mon.0) 888 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T13:41:38.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[13442]: audit 2021-01-27T13:41:37.950577+0000 mgr.y (mgr.14138) 540 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:38.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[13442]: audit 2021-01-27T13:41:38.551818+0000 mon.a (mon.0) 889 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T13:41:38.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:38 smithi037 bash[13442]: cluster 2021-01-27T13:41:38.551941+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T13:41:39.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[13442]: cluster 2021-01-27T13:41:38.317924+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v490: 212 pgs: 2 creating+peering, 19 unknown, 191 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:39.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[13442]: audit 2021-01-27T13:41:38.555384+0000 mon.a (mon.0) 891 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-27T13:41:39.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[13442]: audit 2021-01-27T13:41:38.556875+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T13:41:39.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[13442]: audit 2021-01-27T13:41:39.555009+0000 mon.a (mon.0) 893 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-27T13:41:39.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[13442]: cluster 2021-01-27T13:41:39.555638+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T13:41:39.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[9724]: cluster 2021-01-27T13:41:38.317924+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v490: 212 pgs: 2 creating+peering, 19 unknown, 191 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:39.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[9724]: audit 2021-01-27T13:41:38.555384+0000 mon.a (mon.0) 891 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-27T13:41:39.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[9724]: audit 2021-01-27T13:41:38.556875+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T13:41:39.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[9724]: audit 2021-01-27T13:41:39.555009+0000 mon.a (mon.0) 893 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-27T13:41:39.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:39 smithi037 bash[9724]: cluster 2021-01-27T13:41:39.555638+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T13:41:40.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:39 smithi099 bash[9889]: cluster 2021-01-27T13:41:38.317924+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v490: 212 pgs: 2 creating+peering, 19 unknown, 191 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:40.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:39 smithi099 bash[9889]: audit 2021-01-27T13:41:38.555384+0000 mon.a (mon.0) 891 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-27T13:41:40.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:39 smithi099 bash[9889]: audit 2021-01-27T13:41:38.556875+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T13:41:40.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:39 smithi099 bash[9889]: audit 2021-01-27T13:41:39.555009+0000 mon.a (mon.0) 893 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-27T13:41:40.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:39 smithi099 bash[9889]: cluster 2021-01-27T13:41:39.555638+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T13:41:40.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:40 smithi037 bash[13442]: audit 2021-01-27T13:41:39.558792+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T13:41:40.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:40 smithi037 bash[13442]: audit 2021-01-27T13:41:40.555922+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-27T13:41:40.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:40 smithi037 bash[13442]: cluster 2021-01-27T13:41:40.556077+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T13:41:40.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:40 smithi037 bash[13442]: audit 2021-01-27T13:41:40.560113+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T13:41:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:40 smithi037 bash[9724]: audit 2021-01-27T13:41:39.558792+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T13:41:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:40 smithi037 bash[9724]: audit 2021-01-27T13:41:40.555922+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-27T13:41:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:40 smithi037 bash[9724]: cluster 2021-01-27T13:41:40.556077+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T13:41:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:40 smithi037 bash[9724]: audit 2021-01-27T13:41:40.560113+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T13:41:41.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:40 smithi099 bash[9889]: audit 2021-01-27T13:41:39.558792+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T13:41:41.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:40 smithi099 bash[9889]: audit 2021-01-27T13:41:40.555922+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-27T13:41:41.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:40 smithi099 bash[9889]: cluster 2021-01-27T13:41:40.556077+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T13:41:41.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:40 smithi099 bash[9889]: audit 2021-01-27T13:41:40.560113+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T13:41:42.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:41 smithi099 bash[9889]: cluster 2021-01-27T13:41:40.319171+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v493: 212 pgs: 2 creating+peering, 3 unknown, 207 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:42.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:41 smithi099 bash[9889]: audit 2021-01-27T13:41:41.559207+0000 mon.a (mon.0) 899 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-27T13:41:42.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:41 smithi099 bash[9889]: cluster 2021-01-27T13:41:41.559337+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T13:41:42.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:41 smithi099 bash[9889]: audit 2021-01-27T13:41:41.562066+0000 mon.a (mon.0) 901 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T13:41:42.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:41 smithi037 bash[9724]: cluster 2021-01-27T13:41:40.319171+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v493: 212 pgs: 2 creating+peering, 3 unknown, 207 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:42.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:41 smithi037 bash[9724]: audit 2021-01-27T13:41:41.559207+0000 mon.a (mon.0) 899 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-27T13:41:42.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:41 smithi037 bash[9724]: cluster 2021-01-27T13:41:41.559337+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T13:41:42.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:41 smithi037 bash[9724]: audit 2021-01-27T13:41:41.562066+0000 mon.a (mon.0) 901 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T13:41:42.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:41 smithi037 bash[13442]: cluster 2021-01-27T13:41:40.319171+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v493: 212 pgs: 2 creating+peering, 3 unknown, 207 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:42.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:41 smithi037 bash[13442]: audit 2021-01-27T13:41:41.559207+0000 mon.a (mon.0) 899 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-27T13:41:42.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:41 smithi037 bash[13442]: cluster 2021-01-27T13:41:41.559337+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T13:41:42.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:41 smithi037 bash[13442]: audit 2021-01-27T13:41:41.562066+0000 mon.a (mon.0) 901 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T13:41:43.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:43 smithi037 bash[9724]: cluster 2021-01-27T13:41:42.320172+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v496: 212 pgs: 212 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:43.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:43 smithi037 bash[9724]: audit 2021-01-27T13:41:42.560321+0000 mon.a (mon.0) 902 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-27T13:41:43.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:43 smithi037 bash[9724]: cluster 2021-01-27T13:41:42.560502+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T13:41:43.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:43 smithi037 bash[9724]: audit 2021-01-27T13:41:42.562768+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:43.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:43 smithi037 bash[13442]: cluster 2021-01-27T13:41:42.320172+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v496: 212 pgs: 212 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:43.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:43 smithi037 bash[13442]: audit 2021-01-27T13:41:42.560321+0000 mon.a (mon.0) 902 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-27T13:41:43.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:43 smithi037 bash[13442]: cluster 2021-01-27T13:41:42.560502+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T13:41:43.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:43 smithi037 bash[13442]: audit 2021-01-27T13:41:42.562768+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:44.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:43 smithi099 bash[9889]: cluster 2021-01-27T13:41:42.320172+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v496: 212 pgs: 212 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:41:44.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:43 smithi099 bash[9889]: audit 2021-01-27T13:41:42.560321+0000 mon.a (mon.0) 902 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-27T13:41:44.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:43 smithi099 bash[9889]: cluster 2021-01-27T13:41:42.560502+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T13:41:44.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:43 smithi099 bash[9889]: audit 2021-01-27T13:41:42.562768+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:44.569 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_applications ... ok 2021-01-27T13:41:44.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:44 smithi037 bash[9724]: audit 2021-01-27T13:41:43.563504+0000 mon.a (mon.0) 905 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:44.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:44 smithi037 bash[9724]: cluster 2021-01-27T13:41:43.564402+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T13:41:44.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:44 smithi037 bash[13442]: audit 2021-01-27T13:41:43.563504+0000 mon.a (mon.0) 905 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:44.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:44 smithi037 bash[13442]: cluster 2021-01-27T13:41:43.564402+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T13:41:45.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:44 smithi099 bash[9889]: audit 2021-01-27T13:41:43.563504+0000 mon.a (mon.0) 905 : audit [INF] from='client.? 172.21.15.37:0/3511266135' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:45.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:44 smithi099 bash[9889]: cluster 2021-01-27T13:41:43.564402+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T13:41:46.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:45 smithi099 bash[9889]: cluster 2021-01-27T13:41:44.321195+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v499: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:46.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:45 smithi099 bash[9889]: cluster 2021-01-27T13:41:44.564799+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T13:41:46.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:45 smithi037 bash[9724]: cluster 2021-01-27T13:41:44.321195+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v499: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:46.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:45 smithi037 bash[9724]: cluster 2021-01-27T13:41:44.564799+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T13:41:46.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:45 smithi037 bash[13442]: cluster 2021-01-27T13:41:44.321195+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v499: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:46.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:45 smithi037 bash[13442]: cluster 2021-01-27T13:41:44.564799+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T13:41:47.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:46 smithi099 bash[9889]: cluster 2021-01-27T13:41:45.590549+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T13:41:47.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:46 smithi037 bash[9724]: cluster 2021-01-27T13:41:45.590549+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T13:41:47.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:46 smithi037 bash[13442]: cluster 2021-01-27T13:41:45.590549+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T13:41:47.961 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[9724]: cluster 2021-01-27T13:41:46.322197+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v502: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:47.961 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[9724]: cluster 2021-01-27T13:41:46.599710+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T13:41:47.961 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[9724]: audit 2021-01-27T13:41:46.634140+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.37:0/1794330035' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:47.962 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[9724]: audit 2021-01-27T13:41:46.635133+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:47.962 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:47 smithi099 bash[9889]: cluster 2021-01-27T13:41:46.322197+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v502: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:47.963 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:47 smithi099 bash[9889]: cluster 2021-01-27T13:41:46.599710+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T13:41:47.963 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:47 smithi099 bash[9889]: audit 2021-01-27T13:41:46.634140+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.37:0/1794330035' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:47.963 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:47 smithi099 bash[9889]: audit 2021-01-27T13:41:46.635133+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:47.964 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[9955]: debug 2021-01-27T13:41:47.959+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:41:47.964 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[13442]: cluster 2021-01-27T13:41:46.322197+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v502: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:47.964 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[13442]: cluster 2021-01-27T13:41:46.599710+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T13:41:47.964 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[13442]: audit 2021-01-27T13:41:46.634140+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.37:0/1794330035' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:47.964 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:47 smithi037 bash[13442]: audit 2021-01-27T13:41:46.635133+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:48.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:41:47 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:41:48.609 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_clear_omap ... ok 2021-01-27T13:41:49.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:48 smithi099 bash[9889]: audit 2021-01-27T13:41:47.603185+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:49.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:48 smithi099 bash[9889]: cluster 2021-01-27T13:41:47.603502+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T13:41:49.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:48 smithi099 bash[9889]: audit 2021-01-27T13:41:47.961841+0000 mgr.y (mgr.14138) 546 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:49.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:48 smithi037 bash[9724]: audit 2021-01-27T13:41:47.603185+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:49.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:48 smithi037 bash[9724]: cluster 2021-01-27T13:41:47.603502+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T13:41:49.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:48 smithi037 bash[9724]: audit 2021-01-27T13:41:47.961841+0000 mgr.y (mgr.14138) 546 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:49.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:48 smithi037 bash[13442]: audit 2021-01-27T13:41:47.603185+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:49.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:48 smithi037 bash[13442]: cluster 2021-01-27T13:41:47.603502+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T13:41:49.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:48 smithi037 bash[13442]: audit 2021-01-27T13:41:47.961841+0000 mgr.y (mgr.14138) 546 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:50.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:49 smithi099 bash[9889]: cluster 2021-01-27T13:41:48.323292+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v505: 212 pgs: 4 creating+activating, 4 creating+peering, 18 unknown, 186 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:50.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:49 smithi099 bash[9889]: cluster 2021-01-27T13:41:48.604737+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T13:41:50.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:49 smithi037 bash[9724]: cluster 2021-01-27T13:41:48.323292+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v505: 212 pgs: 4 creating+activating, 4 creating+peering, 18 unknown, 186 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:50.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:49 smithi037 bash[9724]: cluster 2021-01-27T13:41:48.604737+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T13:41:50.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:49 smithi037 bash[13442]: cluster 2021-01-27T13:41:48.323292+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v505: 212 pgs: 4 creating+activating, 4 creating+peering, 18 unknown, 186 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:50.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:49 smithi037 bash[13442]: cluster 2021-01-27T13:41:48.604737+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T13:41:51.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:50 smithi099 bash[9889]: cluster 2021-01-27T13:41:49.628801+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T13:41:51.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:50 smithi037 bash[9724]: cluster 2021-01-27T13:41:49.628801+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T13:41:51.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:50 smithi037 bash[13442]: cluster 2021-01-27T13:41:49.628801+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T13:41:52.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:51 smithi099 bash[9889]: cluster 2021-01-27T13:41:50.324644+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v508: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:52.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:51 smithi099 bash[9889]: cluster 2021-01-27T13:41:50.633863+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T13:41:52.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:51 smithi099 bash[9889]: audit 2021-01-27T13:41:50.669151+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.37:0/4155251101' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:52.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:51 smithi099 bash[9889]: audit 2021-01-27T13:41:50.669771+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:52.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:51 smithi037 bash[9724]: cluster 2021-01-27T13:41:50.324644+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v508: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:52.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:51 smithi037 bash[9724]: cluster 2021-01-27T13:41:50.633863+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T13:41:52.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:51 smithi037 bash[9724]: audit 2021-01-27T13:41:50.669151+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.37:0/4155251101' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:52.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:51 smithi037 bash[9724]: audit 2021-01-27T13:41:50.669771+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:52.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:51 smithi037 bash[13442]: cluster 2021-01-27T13:41:50.324644+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v508: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:52.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:51 smithi037 bash[13442]: cluster 2021-01-27T13:41:50.633863+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T13:41:52.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:51 smithi037 bash[13442]: audit 2021-01-27T13:41:50.669151+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.37:0/4155251101' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:52.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:51 smithi037 bash[13442]: audit 2021-01-27T13:41:50.669771+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:52.670 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_cmpext ... ok 2021-01-27T13:41:53.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:52 smithi099 bash[9889]: audit 2021-01-27T13:41:51.660076+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:53.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:52 smithi099 bash[9889]: cluster 2021-01-27T13:41:51.660342+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T13:41:53.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:52 smithi037 bash[9724]: audit 2021-01-27T13:41:51.660076+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:53.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:52 smithi037 bash[9724]: cluster 2021-01-27T13:41:51.660342+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T13:41:53.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:52 smithi037 bash[13442]: audit 2021-01-27T13:41:51.660076+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:53.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:52 smithi037 bash[13442]: cluster 2021-01-27T13:41:51.660342+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T13:41:54.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:53 smithi099 bash[9889]: cluster 2021-01-27T13:41:52.325550+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v511: 212 pgs: 6 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2021-01-27T13:41:54.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:53 smithi099 bash[9889]: cluster 2021-01-27T13:41:52.655641+0000 mon.a (mon.0) 919 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:41:54.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:53 smithi099 bash[9889]: cluster 2021-01-27T13:41:52.665490+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T13:41:54.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:53 smithi037 bash[9724]: cluster 2021-01-27T13:41:52.325550+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v511: 212 pgs: 6 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2021-01-27T13:41:54.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:53 smithi037 bash[9724]: cluster 2021-01-27T13:41:52.655641+0000 mon.a (mon.0) 919 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:41:54.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:53 smithi037 bash[9724]: cluster 2021-01-27T13:41:52.665490+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T13:41:54.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:53 smithi037 bash[13442]: cluster 2021-01-27T13:41:52.325550+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v511: 212 pgs: 6 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2021-01-27T13:41:54.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:53 smithi037 bash[13442]: cluster 2021-01-27T13:41:52.655641+0000 mon.a (mon.0) 919 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:41:54.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:53 smithi037 bash[13442]: cluster 2021-01-27T13:41:52.665490+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T13:41:55.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:54 smithi099 bash[9889]: cluster 2021-01-27T13:41:53.688149+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T13:41:55.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:54 smithi037 bash[9724]: cluster 2021-01-27T13:41:53.688149+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T13:41:55.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:54 smithi037 bash[13442]: cluster 2021-01-27T13:41:53.688149+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T13:41:56.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:55 smithi099 bash[9889]: cluster 2021-01-27T13:41:54.326636+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v514: 212 pgs: 1 creating+peering, 31 unknown, 180 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:56.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:55 smithi099 bash[9889]: cluster 2021-01-27T13:41:54.698262+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T13:41:56.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:55 smithi099 bash[9889]: audit 2021-01-27T13:41:54.736828+0000 mon.a (mon.0) 923 : audit [INF] from='client.? 172.21.15.37:0/3084540999' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:56.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:55 smithi099 bash[9889]: cluster 2021-01-27T13:41:55.082583+0000 mon.a (mon.0) 924 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:41:56.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:55 smithi099 bash[9889]: cluster 2021-01-27T13:41:55.082647+0000 mon.a (mon.0) 925 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:56.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[9724]: cluster 2021-01-27T13:41:54.326636+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v514: 212 pgs: 1 creating+peering, 31 unknown, 180 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:56.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[9724]: cluster 2021-01-27T13:41:54.698262+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T13:41:56.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[9724]: audit 2021-01-27T13:41:54.736828+0000 mon.a (mon.0) 923 : audit [INF] from='client.? 172.21.15.37:0/3084540999' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:56.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[9724]: cluster 2021-01-27T13:41:55.082583+0000 mon.a (mon.0) 924 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:41:56.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[9724]: cluster 2021-01-27T13:41:55.082647+0000 mon.a (mon.0) 925 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:56.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[13442]: cluster 2021-01-27T13:41:54.326636+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v514: 212 pgs: 1 creating+peering, 31 unknown, 180 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:41:56.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[13442]: cluster 2021-01-27T13:41:54.698262+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T13:41:56.076 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[13442]: audit 2021-01-27T13:41:54.736828+0000 mon.a (mon.0) 923 : audit [INF] from='client.? 172.21.15.37:0/3084540999' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:41:56.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[13442]: cluster 2021-01-27T13:41:55.082583+0000 mon.a (mon.0) 924 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:41:56.077 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:55 smithi037 bash[13442]: cluster 2021-01-27T13:41:55.082647+0000 mon.a (mon.0) 925 : cluster [INF] Cluster is now healthy 2021-01-27T13:41:56.736 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_cmpext_op ... ok 2021-01-27T13:41:57.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:56 smithi099 bash[9889]: audit 2021-01-27T13:41:55.719045+0000 mon.a (mon.0) 926 : audit [INF] from='client.? 172.21.15.37:0/3084540999' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:57.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:56 smithi099 bash[9889]: cluster 2021-01-27T13:41:55.719159+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T13:41:57.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:56 smithi037 bash[9724]: audit 2021-01-27T13:41:55.719045+0000 mon.a (mon.0) 926 : audit [INF] from='client.? 172.21.15.37:0/3084540999' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:57.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:56 smithi037 bash[9724]: cluster 2021-01-27T13:41:55.719159+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T13:41:57.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:56 smithi037 bash[13442]: audit 2021-01-27T13:41:55.719045+0000 mon.a (mon.0) 926 : audit [INF] from='client.? 172.21.15.37:0/3084540999' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:41:57.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:56 smithi037 bash[13442]: cluster 2021-01-27T13:41:55.719159+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T13:41:58.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:57 smithi099 bash[9889]: cluster 2021-01-27T13:41:56.327691+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v517: 212 pgs: 1 creating+peering, 16 unknown, 195 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:58.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:57 smithi099 bash[9889]: cluster 2021-01-27T13:41:56.725562+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T13:41:58.062 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:41:57 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:41:58.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:57 smithi037 bash[9724]: cluster 2021-01-27T13:41:56.327691+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v517: 212 pgs: 1 creating+peering, 16 unknown, 195 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:58.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:57 smithi037 bash[9724]: cluster 2021-01-27T13:41:56.725562+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T13:41:58.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:57 smithi037 bash[13442]: cluster 2021-01-27T13:41:56.327691+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v517: 212 pgs: 1 creating+peering, 16 unknown, 195 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:41:58.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:57 smithi037 bash[13442]: cluster 2021-01-27T13:41:56.725562+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T13:41:58.074 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:41:57 smithi037 bash[9955]: debug 2021-01-27T13:41:57.959+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:41:59.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:58 smithi099 bash[9889]: cluster 2021-01-27T13:41:57.744024+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T13:41:59.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:58 smithi099 bash[9889]: audit 2021-01-27T13:41:57.963847+0000 mgr.y (mgr.14138) 552 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:59.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:58 smithi037 bash[9724]: cluster 2021-01-27T13:41:57.744024+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T13:41:59.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:58 smithi037 bash[9724]: audit 2021-01-27T13:41:57.963847+0000 mgr.y (mgr.14138) 552 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:41:59.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:58 smithi037 bash[13442]: cluster 2021-01-27T13:41:57.744024+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T13:41:59.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:58 smithi037 bash[13442]: audit 2021-01-27T13:41:57.963847+0000 mgr.y (mgr.14138) 552 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:00.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:59 smithi099 bash[9889]: cluster 2021-01-27T13:41:58.328953+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v520: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:00.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:59 smithi099 bash[9889]: cluster 2021-01-27T13:41:58.750840+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T13:42:00.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:59 smithi099 bash[9889]: cluster 2021-01-27T13:41:59.750005+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T13:42:00.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:41:59 smithi099 bash[9889]: audit 2021-01-27T13:41:59.752413+0000 mon.a (mon.0) 932 : audit [INF] from='client.? 172.21.15.37:0/1459853784' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:00.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:59 smithi037 bash[9724]: cluster 2021-01-27T13:41:58.328953+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v520: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:00.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:59 smithi037 bash[9724]: cluster 2021-01-27T13:41:58.750840+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T13:42:00.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:59 smithi037 bash[9724]: cluster 2021-01-27T13:41:59.750005+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T13:42:00.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:41:59 smithi037 bash[9724]: audit 2021-01-27T13:41:59.752413+0000 mon.a (mon.0) 932 : audit [INF] from='client.? 172.21.15.37:0/1459853784' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:00.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:59 smithi037 bash[13442]: cluster 2021-01-27T13:41:58.328953+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v520: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:00.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:59 smithi037 bash[13442]: cluster 2021-01-27T13:41:58.750840+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T13:42:00.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:59 smithi037 bash[13442]: cluster 2021-01-27T13:41:59.750005+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T13:42:00.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:41:59 smithi037 bash[13442]: audit 2021-01-27T13:41:59.752413+0000 mon.a (mon.0) 932 : audit [INF] from='client.? 172.21.15.37:0/1459853784' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:01.765 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_create_snap ... ok 2021-01-27T13:42:02.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:01 smithi099 bash[9889]: cluster 2021-01-27T13:42:00.330170+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v523: 212 pgs: 10 creating+peering, 7 unknown, 195 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:02.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:01 smithi099 bash[9889]: audit 2021-01-27T13:42:00.751980+0000 mon.a (mon.0) 933 : audit [INF] from='client.? 172.21.15.37:0/1459853784' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:02.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:01 smithi099 bash[9889]: cluster 2021-01-27T13:42:00.752160+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T13:42:02.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:01 smithi037 bash[9724]: cluster 2021-01-27T13:42:00.330170+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v523: 212 pgs: 10 creating+peering, 7 unknown, 195 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:02.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:01 smithi037 bash[9724]: audit 2021-01-27T13:42:00.751980+0000 mon.a (mon.0) 933 : audit [INF] from='client.? 172.21.15.37:0/1459853784' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:02.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:01 smithi037 bash[9724]: cluster 2021-01-27T13:42:00.752160+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T13:42:02.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:01 smithi037 bash[13442]: cluster 2021-01-27T13:42:00.330170+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v523: 212 pgs: 10 creating+peering, 7 unknown, 195 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:02.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:01 smithi037 bash[13442]: audit 2021-01-27T13:42:00.751980+0000 mon.a (mon.0) 933 : audit [INF] from='client.? 172.21.15.37:0/1459853784' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:02.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:01 smithi037 bash[13442]: cluster 2021-01-27T13:42:00.752160+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T13:42:03.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:02 smithi099 bash[9889]: cluster 2021-01-27T13:42:01.754643+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T13:42:03.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:02 smithi037 bash[9724]: cluster 2021-01-27T13:42:01.754643+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T13:42:03.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:02 smithi037 bash[13442]: cluster 2021-01-27T13:42:01.754643+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T13:42:04.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:03 smithi099 bash[9889]: cluster 2021-01-27T13:42:02.330931+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v526: 180 pgs: 180 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:04.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:03 smithi099 bash[9889]: cluster 2021-01-27T13:42:02.780393+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T13:42:04.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:03 smithi037 bash[9724]: cluster 2021-01-27T13:42:02.330931+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v526: 180 pgs: 180 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:04.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:03 smithi037 bash[9724]: cluster 2021-01-27T13:42:02.780393+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T13:42:04.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:03 smithi037 bash[13442]: cluster 2021-01-27T13:42:02.330931+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v526: 180 pgs: 180 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:04.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:03 smithi037 bash[13442]: cluster 2021-01-27T13:42:02.780393+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T13:42:05.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:04 smithi099 bash[9889]: cluster 2021-01-27T13:42:03.795332+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T13:42:05.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:04 smithi099 bash[9889]: audit 2021-01-27T13:42:03.833394+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.37:0/2663304970' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:05.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:04 smithi037 bash[9724]: cluster 2021-01-27T13:42:03.795332+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T13:42:05.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:04 smithi037 bash[9724]: audit 2021-01-27T13:42:03.833394+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.37:0/2663304970' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:05.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:04 smithi037 bash[13442]: cluster 2021-01-27T13:42:03.795332+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T13:42:05.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:04 smithi037 bash[13442]: audit 2021-01-27T13:42:03.833394+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.37:0/2663304970' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:05.817 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_execute ... ok 2021-01-27T13:42:06.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:05 smithi037 bash[9724]: cluster 2021-01-27T13:42:04.332044+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v529: 212 pgs: 10 creating+peering, 16 unknown, 186 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:06.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:05 smithi037 bash[9724]: audit 2021-01-27T13:42:04.803320+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.37:0/2663304970' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:06.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:05 smithi037 bash[9724]: cluster 2021-01-27T13:42:04.803428+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T13:42:06.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:05 smithi037 bash[13442]: cluster 2021-01-27T13:42:04.332044+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v529: 212 pgs: 10 creating+peering, 16 unknown, 186 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:06.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:05 smithi037 bash[13442]: audit 2021-01-27T13:42:04.803320+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.37:0/2663304970' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:06.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:05 smithi037 bash[13442]: cluster 2021-01-27T13:42:04.803428+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T13:42:06.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:05 smithi099 bash[9889]: cluster 2021-01-27T13:42:04.332044+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v529: 212 pgs: 10 creating+peering, 16 unknown, 186 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:06.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:05 smithi099 bash[9889]: audit 2021-01-27T13:42:04.803320+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.37:0/2663304970' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:06.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:05 smithi099 bash[9889]: cluster 2021-01-27T13:42:04.803428+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T13:42:07.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:06 smithi099 bash[9889]: cluster 2021-01-27T13:42:05.810293+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T13:42:07.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:06 smithi037 bash[9724]: cluster 2021-01-27T13:42:05.810293+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T13:42:07.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:06 smithi037 bash[13442]: cluster 2021-01-27T13:42:05.810293+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T13:42:08.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:07 smithi099 bash[9889]: cluster 2021-01-27T13:42:06.332970+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v532: 180 pgs: 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:08.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:07 smithi099 bash[9889]: cluster 2021-01-27T13:42:06.837065+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T13:42:08.312 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:42:07 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:42:08.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:42:07 smithi037 bash[9955]: debug 2021-01-27T13:42:07.971+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:42:08.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:07 smithi037 bash[13442]: cluster 2021-01-27T13:42:06.332970+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v532: 180 pgs: 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:08.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:07 smithi037 bash[13442]: cluster 2021-01-27T13:42:06.837065+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T13:42:08.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:07 smithi037 bash[9724]: cluster 2021-01-27T13:42:06.332970+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v532: 180 pgs: 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:08.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:07 smithi037 bash[9724]: cluster 2021-01-27T13:42:06.837065+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T13:42:09.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:08 smithi099 bash[9889]: cluster 2021-01-27T13:42:07.849276+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T13:42:09.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:08 smithi099 bash[9889]: audit 2021-01-27T13:42:07.885155+0000 mon.a (mon.0) 944 : audit [INF] from='client.? 172.21.15.37:0/451113192' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:09.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:08 smithi099 bash[9889]: audit 2021-01-27T13:42:07.975192+0000 mgr.y (mgr.14138) 558 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:09.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:08 smithi037 bash[9724]: cluster 2021-01-27T13:42:07.849276+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T13:42:09.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:08 smithi037 bash[9724]: audit 2021-01-27T13:42:07.885155+0000 mon.a (mon.0) 944 : audit [INF] from='client.? 172.21.15.37:0/451113192' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:09.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:08 smithi037 bash[9724]: audit 2021-01-27T13:42:07.975192+0000 mgr.y (mgr.14138) 558 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:09.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:08 smithi037 bash[13442]: cluster 2021-01-27T13:42:07.849276+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T13:42:09.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:08 smithi037 bash[13442]: audit 2021-01-27T13:42:07.885155+0000 mon.a (mon.0) 944 : audit [INF] from='client.? 172.21.15.37:0/451113192' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:09.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:08 smithi037 bash[13442]: audit 2021-01-27T13:42:07.975192+0000 mgr.y (mgr.14138) 558 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:09.872 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_execute_op ... ok 2021-01-27T13:42:10.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:09 smithi099 bash[9889]: cluster 2021-01-27T13:42:08.334354+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v535: 212 pgs: 19 unknown, 193 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:10.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:09 smithi099 bash[9889]: audit 2021-01-27T13:42:08.858886+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.37:0/451113192' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:10.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:09 smithi099 bash[9889]: cluster 2021-01-27T13:42:08.859294+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T13:42:10.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:09 smithi037 bash[13442]: cluster 2021-01-27T13:42:08.334354+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v535: 212 pgs: 19 unknown, 193 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:10.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:09 smithi037 bash[13442]: audit 2021-01-27T13:42:08.858886+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.37:0/451113192' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:10.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:09 smithi037 bash[13442]: cluster 2021-01-27T13:42:08.859294+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T13:42:10.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:09 smithi037 bash[9724]: cluster 2021-01-27T13:42:08.334354+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v535: 212 pgs: 19 unknown, 193 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:10.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:09 smithi037 bash[9724]: audit 2021-01-27T13:42:08.858886+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.37:0/451113192' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:10.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:09 smithi037 bash[9724]: cluster 2021-01-27T13:42:08.859294+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T13:42:11.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:10 smithi099 bash[9889]: cluster 2021-01-27T13:42:09.861048+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T13:42:11.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:10 smithi037 bash[9724]: cluster 2021-01-27T13:42:09.861048+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T13:42:11.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:10 smithi037 bash[13442]: cluster 2021-01-27T13:42:09.861048+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T13:42:12.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:11 smithi099 bash[9889]: cluster 2021-01-27T13:42:10.335470+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v538: 180 pgs: 180 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:12.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:11 smithi099 bash[9889]: cluster 2021-01-27T13:42:10.881180+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T13:42:12.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:11 smithi099 bash[9889]: audit 2021-01-27T13:42:10.884843+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.37:0/1232647977' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:12.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:11 smithi099 bash[9889]: audit 2021-01-27T13:42:10.885706+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:12.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:11 smithi037 bash[9724]: cluster 2021-01-27T13:42:10.335470+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v538: 180 pgs: 180 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:12.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:11 smithi037 bash[9724]: cluster 2021-01-27T13:42:10.881180+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T13:42:12.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:11 smithi037 bash[9724]: audit 2021-01-27T13:42:10.884843+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.37:0/1232647977' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:12.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:11 smithi037 bash[9724]: audit 2021-01-27T13:42:10.885706+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:12.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:11 smithi037 bash[13442]: cluster 2021-01-27T13:42:10.335470+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v538: 180 pgs: 180 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:12.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:11 smithi037 bash[13442]: cluster 2021-01-27T13:42:10.881180+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T13:42:12.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:11 smithi037 bash[13442]: audit 2021-01-27T13:42:10.884843+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.37:0/1232647977' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:12.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:11 smithi037 bash[13442]: audit 2021-01-27T13:42:10.885706+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:12.913 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_get_last_version ... ok 2021-01-27T13:42:13.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:12 smithi099 bash[9889]: audit 2021-01-27T13:42:11.886409+0000 mon.a (mon.0) 950 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:13.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:12 smithi099 bash[9889]: cluster 2021-01-27T13:42:11.887059+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T13:42:13.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:12 smithi037 bash[9724]: audit 2021-01-27T13:42:11.886409+0000 mon.a (mon.0) 950 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:13.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:12 smithi037 bash[9724]: cluster 2021-01-27T13:42:11.887059+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T13:42:13.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:12 smithi037 bash[13442]: audit 2021-01-27T13:42:11.886409+0000 mon.a (mon.0) 950 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:13.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:12 smithi037 bash[13442]: cluster 2021-01-27T13:42:11.887059+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T13:42:14.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:13 smithi099 bash[9889]: cluster 2021-01-27T13:42:12.336262+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v541: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:14.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:13 smithi099 bash[9889]: cluster 2021-01-27T13:42:12.909495+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T13:42:14.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:13 smithi037 bash[13442]: cluster 2021-01-27T13:42:12.336262+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v541: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:14.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:13 smithi037 bash[13442]: cluster 2021-01-27T13:42:12.909495+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T13:42:14.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:13 smithi037 bash[9724]: cluster 2021-01-27T13:42:12.336262+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v541: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:14.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:13 smithi037 bash[9724]: cluster 2021-01-27T13:42:12.909495+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T13:42:15.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:14 smithi099 bash[9889]: cluster 2021-01-27T13:42:13.925402+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T13:42:15.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:14 smithi099 bash[9889]: audit 2021-01-27T13:42:14.334561+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:42:15.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:14 smithi099 bash[9889]: audit 2021-01-27T13:42:14.334903+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:42:15.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:14 smithi037 bash[9724]: cluster 2021-01-27T13:42:13.925402+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T13:42:15.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:14 smithi037 bash[9724]: audit 2021-01-27T13:42:14.334561+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:42:15.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:14 smithi037 bash[9724]: audit 2021-01-27T13:42:14.334903+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:42:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:14 smithi037 bash[13442]: cluster 2021-01-27T13:42:13.925402+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T13:42:15.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:14 smithi037 bash[13442]: audit 2021-01-27T13:42:14.334561+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:42:15.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:14 smithi037 bash[13442]: audit 2021-01-27T13:42:14.334903+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:42:16.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:15 smithi099 bash[9889]: cluster 2021-01-27T13:42:14.337300+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v544: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 171 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:16.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:15 smithi099 bash[9889]: cluster 2021-01-27T13:42:14.927589+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T13:42:16.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:15 smithi099 bash[9889]: audit 2021-01-27T13:42:14.966138+0000 mon.a (mon.0) 957 : audit [INF] from='client.? 172.21.15.37:0/595581489' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:16.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:15 smithi037 bash[9724]: cluster 2021-01-27T13:42:14.337300+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v544: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 171 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:15 smithi037 bash[9724]: cluster 2021-01-27T13:42:14.927589+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T13:42:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:15 smithi037 bash[9724]: audit 2021-01-27T13:42:14.966138+0000 mon.a (mon.0) 957 : audit [INF] from='client.? 172.21.15.37:0/595581489' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:16.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:15 smithi037 bash[13442]: cluster 2021-01-27T13:42:14.337300+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v544: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 171 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:16.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:15 smithi037 bash[13442]: cluster 2021-01-27T13:42:14.927589+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T13:42:16.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:15 smithi037 bash[13442]: audit 2021-01-27T13:42:14.966138+0000 mon.a (mon.0) 957 : audit [INF] from='client.? 172.21.15.37:0/595581489' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:16.960 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_get_omap_keys ... ok 2021-01-27T13:42:17.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:16 smithi099 bash[9889]: audit 2021-01-27T13:42:15.952665+0000 mon.a (mon.0) 958 : audit [INF] from='client.? 172.21.15.37:0/595581489' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:17.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:16 smithi099 bash[9889]: cluster 2021-01-27T13:42:15.952966+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T13:42:17.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:16 smithi037 bash[9724]: audit 2021-01-27T13:42:15.952665+0000 mon.a (mon.0) 958 : audit [INF] from='client.? 172.21.15.37:0/595581489' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:17.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:16 smithi037 bash[9724]: cluster 2021-01-27T13:42:15.952966+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T13:42:17.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:16 smithi037 bash[13442]: audit 2021-01-27T13:42:15.952665+0000 mon.a (mon.0) 958 : audit [INF] from='client.? 172.21.15.37:0/595581489' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:17.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:16 smithi037 bash[13442]: cluster 2021-01-27T13:42:15.952966+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T13:42:18.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:42:17 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:42:18.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:17 smithi099 bash[9889]: cluster 2021-01-27T13:42:16.338325+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v547: 212 pgs: 7 creating+peering, 12 unknown, 193 active+clean; 25 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:42:18.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:17 smithi099 bash[9889]: cluster 2021-01-27T13:42:16.948960+0000 mon.a (mon.0) 960 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:42:18.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:17 smithi099 bash[9889]: cluster 2021-01-27T13:42:16.956883+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T13:42:18.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:42:17 smithi037 bash[9955]: debug 2021-01-27T13:42:17.979+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:42:18.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:17 smithi037 bash[9724]: cluster 2021-01-27T13:42:16.338325+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v547: 212 pgs: 7 creating+peering, 12 unknown, 193 active+clean; 25 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:42:18.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:17 smithi037 bash[9724]: cluster 2021-01-27T13:42:16.948960+0000 mon.a (mon.0) 960 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:42:18.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:17 smithi037 bash[9724]: cluster 2021-01-27T13:42:16.956883+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T13:42:18.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:17 smithi037 bash[13442]: cluster 2021-01-27T13:42:16.338325+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v547: 212 pgs: 7 creating+peering, 12 unknown, 193 active+clean; 25 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:42:18.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:17 smithi037 bash[13442]: cluster 2021-01-27T13:42:16.948960+0000 mon.a (mon.0) 960 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:42:18.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:17 smithi037 bash[13442]: cluster 2021-01-27T13:42:16.956883+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T13:42:19.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:19 smithi099 bash[9889]: cluster 2021-01-27T13:42:17.977900+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T13:42:19.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:19 smithi099 bash[9889]: audit 2021-01-27T13:42:17.983821+0000 mgr.y (mgr.14138) 564 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:19.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:18 smithi037 bash[9724]: cluster 2021-01-27T13:42:17.977900+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T13:42:19.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:18 smithi037 bash[9724]: audit 2021-01-27T13:42:17.983821+0000 mgr.y (mgr.14138) 564 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:19.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:19 smithi037 bash[13442]: cluster 2021-01-27T13:42:17.977900+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T13:42:19.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:19 smithi037 bash[13442]: audit 2021-01-27T13:42:17.983821+0000 mgr.y (mgr.14138) 564 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:20.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:20 smithi099 bash[9889]: cluster 2021-01-27T13:42:18.339515+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v550: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:20.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:20 smithi099 bash[9889]: cluster 2021-01-27T13:42:18.974997+0000 mon.a (mon.0) 963 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:42:20.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:20 smithi099 bash[9889]: cluster 2021-01-27T13:42:18.975065+0000 mon.a (mon.0) 964 : cluster [INF] Cluster is now healthy 2021-01-27T13:42:20.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:20 smithi099 bash[9889]: cluster 2021-01-27T13:42:18.982395+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T13:42:20.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:20 smithi099 bash[9889]: audit 2021-01-27T13:42:19.023740+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.37:0/3834534188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:20.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:20 smithi099 bash[9889]: audit 2021-01-27T13:42:19.024115+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:20.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[9724]: cluster 2021-01-27T13:42:18.339515+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v550: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:20.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[9724]: cluster 2021-01-27T13:42:18.974997+0000 mon.a (mon.0) 963 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:42:20.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[9724]: cluster 2021-01-27T13:42:18.975065+0000 mon.a (mon.0) 964 : cluster [INF] Cluster is now healthy 2021-01-27T13:42:20.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[9724]: cluster 2021-01-27T13:42:18.982395+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T13:42:20.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[9724]: audit 2021-01-27T13:42:19.023740+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.37:0/3834534188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:20.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[9724]: audit 2021-01-27T13:42:19.024115+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:20.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[13442]: cluster 2021-01-27T13:42:18.339515+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v550: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 177 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:20.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[13442]: cluster 2021-01-27T13:42:18.974997+0000 mon.a (mon.0) 963 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:42:20.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[13442]: cluster 2021-01-27T13:42:18.975065+0000 mon.a (mon.0) 964 : cluster [INF] Cluster is now healthy 2021-01-27T13:42:20.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[13442]: cluster 2021-01-27T13:42:18.982395+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T13:42:20.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[13442]: audit 2021-01-27T13:42:19.023740+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.37:0/3834534188' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:20.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:20 smithi037 bash[13442]: audit 2021-01-27T13:42:19.024115+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:21.032 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_get_omap_vals_by_keys ... ok 2021-01-27T13:42:21.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:21 smithi099 bash[9889]: audit 2021-01-27T13:42:20.005831+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:21.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:21 smithi099 bash[9889]: cluster 2021-01-27T13:42:20.005955+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T13:42:21.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:21 smithi037 bash[9724]: audit 2021-01-27T13:42:20.005831+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:21.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:21 smithi037 bash[9724]: cluster 2021-01-27T13:42:20.005955+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T13:42:21.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:21 smithi037 bash[13442]: audit 2021-01-27T13:42:20.005831+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:21.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:21 smithi037 bash[13442]: cluster 2021-01-27T13:42:20.005955+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T13:42:22.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:22 smithi099 bash[9889]: cluster 2021-01-27T13:42:20.340751+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v553: 212 pgs: 8 creating+peering, 14 unknown, 190 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:22.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:22 smithi099 bash[9889]: cluster 2021-01-27T13:42:21.013554+0000 mon.a (mon.0) 969 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:42:22.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:22 smithi099 bash[9889]: cluster 2021-01-27T13:42:21.022563+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T13:42:22.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:22 smithi037 bash[9724]: cluster 2021-01-27T13:42:20.340751+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v553: 212 pgs: 8 creating+peering, 14 unknown, 190 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:22.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:22 smithi037 bash[9724]: cluster 2021-01-27T13:42:21.013554+0000 mon.a (mon.0) 969 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:42:22.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:22 smithi037 bash[9724]: cluster 2021-01-27T13:42:21.022563+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T13:42:22.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:22 smithi037 bash[13442]: cluster 2021-01-27T13:42:20.340751+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v553: 212 pgs: 8 creating+peering, 14 unknown, 190 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:22.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:22 smithi037 bash[13442]: cluster 2021-01-27T13:42:21.013554+0000 mon.a (mon.0) 969 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:42:22.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:22 smithi037 bash[13442]: cluster 2021-01-27T13:42:21.022563+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T13:42:23.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:23 smithi099 bash[9889]: cluster 2021-01-27T13:42:22.045449+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T13:42:23.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:23 smithi099 bash[9889]: audit 2021-01-27T13:42:22.052025+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.37:0/1741058652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:23.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:23 smithi037 bash[9724]: cluster 2021-01-27T13:42:22.045449+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T13:42:23.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:23 smithi037 bash[9724]: audit 2021-01-27T13:42:22.052025+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.37:0/1741058652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:23.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:23 smithi037 bash[13442]: cluster 2021-01-27T13:42:22.045449+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T13:42:23.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:23 smithi037 bash[13442]: audit 2021-01-27T13:42:22.052025+0000 mon.a (mon.0) 972 : audit [INF] from='client.? 172.21.15.37:0/1741058652' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_get_pool_id ... ok 2021-01-27T13:42:24.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[9724]: cluster 2021-01-27T13:42:22.341657+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v556: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 182 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:24.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[9724]: cluster 2021-01-27T13:42:23.041720+0000 mon.a (mon.0) 973 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:42:24.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[9724]: cluster 2021-01-27T13:42:23.041772+0000 mon.a (mon.0) 974 : cluster [INF] Cluster is now healthy 2021-01-27T13:42:24.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[9724]: audit 2021-01-27T13:42:23.050438+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.37:0/1741058652' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:24.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[9724]: cluster 2021-01-27T13:42:23.051991+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T13:42:24.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[9724]: cluster 2021-01-27T13:42:24.053332+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T13:42:24.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[13442]: cluster 2021-01-27T13:42:22.341657+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v556: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 182 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:24.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[13442]: cluster 2021-01-27T13:42:23.041720+0000 mon.a (mon.0) 973 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:42:24.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[13442]: cluster 2021-01-27T13:42:23.041772+0000 mon.a (mon.0) 974 : cluster [INF] Cluster is now healthy 2021-01-27T13:42:24.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[13442]: audit 2021-01-27T13:42:23.050438+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.37:0/1741058652' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:24.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[13442]: cluster 2021-01-27T13:42:23.051991+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T13:42:24.326 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:24 smithi037 bash[13442]: cluster 2021-01-27T13:42:24.053332+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T13:42:24.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:24 smithi099 bash[9889]: cluster 2021-01-27T13:42:22.341657+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v556: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 182 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:24.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:24 smithi099 bash[9889]: cluster 2021-01-27T13:42:23.041720+0000 mon.a (mon.0) 973 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:42:24.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:24 smithi099 bash[9889]: cluster 2021-01-27T13:42:23.041772+0000 mon.a (mon.0) 974 : cluster [INF] Cluster is now healthy 2021-01-27T13:42:24.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:24 smithi099 bash[9889]: audit 2021-01-27T13:42:23.050438+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.37:0/1741058652' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:24.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:24 smithi099 bash[9889]: cluster 2021-01-27T13:42:23.051991+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T13:42:24.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:24 smithi099 bash[9889]: cluster 2021-01-27T13:42:24.053332+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T13:42:26.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:26 smithi099 bash[9889]: cluster 2021-01-27T13:42:24.342606+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v559: 180 pgs: 180 active+clean; 25 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:42:26.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:26 smithi099 bash[9889]: cluster 2021-01-27T13:42:25.083764+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T13:42:26.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:26 smithi099 bash[9889]: audit 2021-01-27T13:42:25.087207+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.37:0/555527197' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:26.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:26 smithi099 bash[9889]: audit 2021-01-27T13:42:25.089730+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:26.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:26 smithi037 bash[9724]: cluster 2021-01-27T13:42:24.342606+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v559: 180 pgs: 180 active+clean; 25 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:42:26.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:26 smithi037 bash[9724]: cluster 2021-01-27T13:42:25.083764+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T13:42:26.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:26 smithi037 bash[9724]: audit 2021-01-27T13:42:25.087207+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.37:0/555527197' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:26.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:26 smithi037 bash[9724]: audit 2021-01-27T13:42:25.089730+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:26.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:26 smithi037 bash[13442]: cluster 2021-01-27T13:42:24.342606+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v559: 180 pgs: 180 active+clean; 25 KiB data, 187 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T13:42:26.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:26 smithi037 bash[13442]: cluster 2021-01-27T13:42:25.083764+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T13:42:26.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:26 smithi037 bash[13442]: audit 2021-01-27T13:42:25.087207+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.37:0/555527197' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:26.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:26 smithi037 bash[13442]: audit 2021-01-27T13:42:25.089730+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:27.088 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_get_pool_name ... ok 2021-01-27T13:42:27.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:27 smithi099 bash[9889]: audit 2021-01-27T13:42:26.082297+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:27.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:27 smithi099 bash[9889]: cluster 2021-01-27T13:42:26.082690+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T13:42:27.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:27 smithi099 bash[9889]: cluster 2021-01-27T13:42:27.084938+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T13:42:27.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:27 smithi037 bash[13442]: audit 2021-01-27T13:42:26.082297+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:27.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:27 smithi037 bash[13442]: cluster 2021-01-27T13:42:26.082690+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T13:42:27.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:27 smithi037 bash[13442]: cluster 2021-01-27T13:42:27.084938+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T13:42:27.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:27 smithi037 bash[9724]: audit 2021-01-27T13:42:26.082297+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:27.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:27 smithi037 bash[9724]: cluster 2021-01-27T13:42:26.082690+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T13:42:27.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:27 smithi037 bash[9724]: cluster 2021-01-27T13:42:27.084938+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T13:42:28.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:28 smithi099 bash[9889]: cluster 2021-01-27T13:42:26.343582+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v562: 212 pgs: 8 creating+peering, 22 unknown, 182 active+clean; 25 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:28.312 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:42:27 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:42:28.327 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:28 smithi037 bash[9724]: cluster 2021-01-27T13:42:26.343582+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v562: 212 pgs: 8 creating+peering, 22 unknown, 182 active+clean; 25 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:28.328 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:28 smithi037 bash[13442]: cluster 2021-01-27T13:42:26.343582+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v562: 212 pgs: 8 creating+peering, 22 unknown, 182 active+clean; 25 KiB data, 192 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:28.328 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:42:27 smithi037 bash[9955]: debug 2021-01-27T13:42:27.987+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:42:29.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:29 smithi099 bash[9889]: audit 2021-01-27T13:42:27.991840+0000 mgr.y (mgr.14138) 570 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:29.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:29 smithi099 bash[9889]: cluster 2021-01-27T13:42:28.114171+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T13:42:29.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:29 smithi099 bash[9889]: audit 2021-01-27T13:42:28.121030+0000 mon.a (mon.0) 984 : audit [INF] from='client.? 172.21.15.37:0/4173524576' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:29.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:29 smithi037 bash[9724]: audit 2021-01-27T13:42:27.991840+0000 mgr.y (mgr.14138) 570 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:29.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:29 smithi037 bash[9724]: cluster 2021-01-27T13:42:28.114171+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T13:42:29.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:29 smithi037 bash[9724]: audit 2021-01-27T13:42:28.121030+0000 mon.a (mon.0) 984 : audit [INF] from='client.? 172.21.15.37:0/4173524576' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:29.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:29 smithi037 bash[13442]: audit 2021-01-27T13:42:27.991840+0000 mgr.y (mgr.14138) 570 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:29.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:29 smithi037 bash[13442]: cluster 2021-01-27T13:42:28.114171+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T13:42:29.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:29 smithi037 bash[13442]: audit 2021-01-27T13:42:28.121030+0000 mon.a (mon.0) 984 : audit [INF] from='client.? 172.21.15.37:0/4173524576' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:30.129 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_get_stats ... ok 2021-01-27T13:42:30.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:30 smithi099 bash[9889]: cluster 2021-01-27T13:42:28.344846+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v565: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 193 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:30.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:30 smithi099 bash[9889]: audit 2021-01-27T13:42:29.122783+0000 mon.a (mon.0) 985 : audit [INF] from='client.? 172.21.15.37:0/4173524576' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:30.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:30 smithi099 bash[9889]: cluster 2021-01-27T13:42:29.124632+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T13:42:30.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:30 smithi099 bash[9889]: cluster 2021-01-27T13:42:30.125008+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T13:42:30.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:30 smithi037 bash[9724]: cluster 2021-01-27T13:42:28.344846+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v565: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 193 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:30.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:30 smithi037 bash[9724]: audit 2021-01-27T13:42:29.122783+0000 mon.a (mon.0) 985 : audit [INF] from='client.? 172.21.15.37:0/4173524576' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:30.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:30 smithi037 bash[9724]: cluster 2021-01-27T13:42:29.124632+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T13:42:30.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:30 smithi037 bash[9724]: cluster 2021-01-27T13:42:30.125008+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T13:42:30.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:30 smithi037 bash[13442]: cluster 2021-01-27T13:42:28.344846+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v565: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 193 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:30.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:30 smithi037 bash[13442]: audit 2021-01-27T13:42:29.122783+0000 mon.a (mon.0) 985 : audit [INF] from='client.? 172.21.15.37:0/4173524576' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:30.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:30 smithi037 bash[13442]: cluster 2021-01-27T13:42:29.124632+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T13:42:30.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:30 smithi037 bash[13442]: cluster 2021-01-27T13:42:30.125008+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T13:42:32.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:32 smithi099 bash[9889]: cluster 2021-01-27T13:42:30.345850+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v568: 180 pgs: 180 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:32.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:32 smithi099 bash[9889]: cluster 2021-01-27T13:42:31.149655+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T13:42:32.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:32 smithi037 bash[9724]: cluster 2021-01-27T13:42:30.345850+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v568: 180 pgs: 180 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:32.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:32 smithi037 bash[9724]: cluster 2021-01-27T13:42:31.149655+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T13:42:32.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:32 smithi037 bash[13442]: cluster 2021-01-27T13:42:30.345850+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v568: 180 pgs: 180 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:32.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:32 smithi037 bash[13442]: cluster 2021-01-27T13:42:31.149655+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T13:42:33.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:33 smithi099 bash[9889]: cluster 2021-01-27T13:42:32.154136+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T13:42:33.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:33 smithi099 bash[9889]: audit 2021-01-27T13:42:32.234303+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.37:0/1403891739' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:33.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:33 smithi099 bash[9889]: audit 2021-01-27T13:42:32.235116+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:33.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:33 smithi037 bash[9724]: cluster 2021-01-27T13:42:32.154136+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T13:42:33.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:33 smithi037 bash[9724]: audit 2021-01-27T13:42:32.234303+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.37:0/1403891739' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:33.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:33 smithi037 bash[9724]: audit 2021-01-27T13:42:32.235116+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:33.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:33 smithi037 bash[13442]: cluster 2021-01-27T13:42:32.154136+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T13:42:33.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:33 smithi037 bash[13442]: audit 2021-01-27T13:42:32.234303+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.37:0/1403891739' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:33.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:33 smithi037 bash[13442]: audit 2021-01-27T13:42:32.235116+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:34.188 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_list_ns_objects ... ok 2021-01-27T13:42:34.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:34 smithi099 bash[9889]: cluster 2021-01-27T13:42:32.346584+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v571: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 202 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:34.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:34 smithi099 bash[9889]: audit 2021-01-27T13:42:33.175886+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:34.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:34 smithi099 bash[9889]: cluster 2021-01-27T13:42:33.176397+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T13:42:34.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:34 smithi037 bash[9724]: cluster 2021-01-27T13:42:32.346584+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v571: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 202 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:34.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:34 smithi037 bash[9724]: audit 2021-01-27T13:42:33.175886+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:34.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:34 smithi037 bash[9724]: cluster 2021-01-27T13:42:33.176397+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T13:42:34.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:34 smithi037 bash[13442]: cluster 2021-01-27T13:42:32.346584+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v571: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 202 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:34.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:34 smithi037 bash[13442]: audit 2021-01-27T13:42:33.175886+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:34.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:34 smithi037 bash[13442]: cluster 2021-01-27T13:42:33.176397+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T13:42:35.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:35 smithi099 bash[9889]: cluster 2021-01-27T13:42:34.179863+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T13:42:35.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:35 smithi099 bash[9889]: cluster 2021-01-27T13:42:34.347461+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v574: 180 pgs: 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:35.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:35 smithi037 bash[9724]: cluster 2021-01-27T13:42:34.179863+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T13:42:35.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:35 smithi037 bash[9724]: cluster 2021-01-27T13:42:34.347461+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v574: 180 pgs: 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:35.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:35 smithi037 bash[13442]: cluster 2021-01-27T13:42:34.179863+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T13:42:35.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:35 smithi037 bash[13442]: cluster 2021-01-27T13:42:34.347461+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v574: 180 pgs: 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:36.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:36 smithi099 bash[9889]: cluster 2021-01-27T13:42:35.201658+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T13:42:36.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:36 smithi037 bash[9724]: cluster 2021-01-27T13:42:35.201658+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T13:42:36.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:36 smithi037 bash[13442]: cluster 2021-01-27T13:42:35.201658+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T13:42:37.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:37 smithi099 bash[9889]: cluster 2021-01-27T13:42:36.211862+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T13:42:37.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:37 smithi099 bash[9889]: audit 2021-01-27T13:42:36.282643+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.37:0/3799697129' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:37.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:37 smithi099 bash[9889]: audit 2021-01-27T13:42:36.283216+0000 mon.a (mon.0) 996 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:37.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:37 smithi099 bash[9889]: cluster 2021-01-27T13:42:36.348634+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v577: 212 pgs: 5 creating+activating, 10 creating+peering, 17 unknown, 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:37 smithi037 bash[9724]: cluster 2021-01-27T13:42:36.211862+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T13:42:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:37 smithi037 bash[9724]: audit 2021-01-27T13:42:36.282643+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.37:0/3799697129' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:37 smithi037 bash[9724]: audit 2021-01-27T13:42:36.283216+0000 mon.a (mon.0) 996 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:37 smithi037 bash[9724]: cluster 2021-01-27T13:42:36.348634+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v577: 212 pgs: 5 creating+activating, 10 creating+peering, 17 unknown, 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:37.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:37 smithi037 bash[13442]: cluster 2021-01-27T13:42:36.211862+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T13:42:37.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:37 smithi037 bash[13442]: audit 2021-01-27T13:42:36.282643+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.37:0/3799697129' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:37.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:37 smithi037 bash[13442]: audit 2021-01-27T13:42:36.283216+0000 mon.a (mon.0) 996 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:37.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:37 smithi037 bash[13442]: cluster 2021-01-27T13:42:36.348634+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v577: 212 pgs: 5 creating+activating, 10 creating+peering, 17 unknown, 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:38.233 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_list_objects ... ok 2021-01-27T13:42:38.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:42:38 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:42:38.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:38 smithi099 bash[9889]: audit 2021-01-27T13:42:37.222373+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:38.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:38 smithi099 bash[9889]: cluster 2021-01-27T13:42:37.222504+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T13:42:38.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:38 smithi099 bash[9889]: audit 2021-01-27T13:42:38.003196+0000 mgr.y (mgr.14138) 576 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:38.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:42:38 smithi037 bash[9955]: debug 2021-01-27T13:42:37.998+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:42:38.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:38 smithi037 bash[9724]: audit 2021-01-27T13:42:37.222373+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:38.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:38 smithi037 bash[9724]: cluster 2021-01-27T13:42:37.222504+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T13:42:38.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:38 smithi037 bash[9724]: audit 2021-01-27T13:42:38.003196+0000 mgr.y (mgr.14138) 576 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:38.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:38 smithi037 bash[13442]: audit 2021-01-27T13:42:37.222373+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:38.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:38 smithi037 bash[13442]: cluster 2021-01-27T13:42:37.222504+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T13:42:38.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:38 smithi037 bash[13442]: audit 2021-01-27T13:42:38.003196+0000 mgr.y (mgr.14138) 576 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:39.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:39 smithi099 bash[9889]: cluster 2021-01-27T13:42:38.227614+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T13:42:39.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:39 smithi099 bash[9889]: cluster 2021-01-27T13:42:38.349824+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v580: 180 pgs: 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:39.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:39 smithi037 bash[9724]: cluster 2021-01-27T13:42:38.227614+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T13:42:39.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:39 smithi037 bash[9724]: cluster 2021-01-27T13:42:38.349824+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v580: 180 pgs: 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:39.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:39 smithi037 bash[13442]: cluster 2021-01-27T13:42:38.227614+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T13:42:39.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:39 smithi037 bash[13442]: cluster 2021-01-27T13:42:38.349824+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v580: 180 pgs: 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:40.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:40 smithi099 bash[9889]: cluster 2021-01-27T13:42:39.255992+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T13:42:40.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:40 smithi037 bash[9724]: cluster 2021-01-27T13:42:39.255992+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T13:42:40.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:40 smithi037 bash[13442]: cluster 2021-01-27T13:42:39.255992+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T13:42:41.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:41 smithi099 bash[9889]: cluster 2021-01-27T13:42:40.257101+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T13:42:41.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:41 smithi099 bash[9889]: audit 2021-01-27T13:42:40.318120+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.37:0/2685363668' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:41.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:41 smithi099 bash[9889]: audit 2021-01-27T13:42:40.318686+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:41.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:41 smithi099 bash[9889]: cluster 2021-01-27T13:42:40.350989+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v583: 212 pgs: 7 creating+peering, 22 unknown, 183 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:41.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:41 smithi037 bash[9724]: cluster 2021-01-27T13:42:40.257101+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T13:42:41.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:41 smithi037 bash[9724]: audit 2021-01-27T13:42:40.318120+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.37:0/2685363668' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:41.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:41 smithi037 bash[9724]: audit 2021-01-27T13:42:40.318686+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:41.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:41 smithi037 bash[9724]: cluster 2021-01-27T13:42:40.350989+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v583: 212 pgs: 7 creating+peering, 22 unknown, 183 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:41.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:41 smithi037 bash[13442]: cluster 2021-01-27T13:42:40.257101+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T13:42:41.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:41 smithi037 bash[13442]: audit 2021-01-27T13:42:40.318120+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.37:0/2685363668' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:41.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:41 smithi037 bash[13442]: audit 2021-01-27T13:42:40.318686+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:41.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:41 smithi037 bash[13442]: cluster 2021-01-27T13:42:40.350989+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v583: 212 pgs: 7 creating+peering, 22 unknown, 183 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:42.308 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_list_objects_empty ... ok 2021-01-27T13:42:42.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:42 smithi099 bash[9889]: audit 2021-01-27T13:42:41.282852+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:42.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:42 smithi099 bash[9889]: cluster 2021-01-27T13:42:41.282962+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T13:42:42.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:42 smithi037 bash[9724]: audit 2021-01-27T13:42:41.282852+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:42.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:42 smithi037 bash[9724]: cluster 2021-01-27T13:42:41.282962+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T13:42:42.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:42 smithi037 bash[13442]: audit 2021-01-27T13:42:41.282852+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:42.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:42 smithi037 bash[13442]: cluster 2021-01-27T13:42:41.282962+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T13:42:43.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:43 smithi099 bash[9889]: cluster 2021-01-27T13:42:42.296353+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T13:42:43.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:43 smithi099 bash[9889]: cluster 2021-01-27T13:42:42.351732+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v586: 180 pgs: 180 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:43.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:43 smithi037 bash[9724]: cluster 2021-01-27T13:42:42.296353+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T13:42:43.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:43 smithi037 bash[9724]: cluster 2021-01-27T13:42:42.351732+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v586: 180 pgs: 180 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:43.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:43 smithi037 bash[13442]: cluster 2021-01-27T13:42:42.296353+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T13:42:43.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:43 smithi037 bash[13442]: cluster 2021-01-27T13:42:42.351732+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v586: 180 pgs: 180 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:44.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:44 smithi037 bash[9724]: cluster 2021-01-27T13:42:43.306685+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T13:42:44.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:44 smithi037 bash[13442]: cluster 2021-01-27T13:42:43.306685+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T13:42:44.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:44 smithi099 bash[9889]: cluster 2021-01-27T13:42:43.306685+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T13:42:45.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:45 smithi099 bash[9889]: cluster 2021-01-27T13:42:44.310159+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T13:42:45.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:45 smithi099 bash[9889]: cluster 2021-01-27T13:42:44.352238+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v589: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:45.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:45 smithi037 bash[9724]: cluster 2021-01-27T13:42:44.310159+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T13:42:45.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:45 smithi037 bash[9724]: cluster 2021-01-27T13:42:44.352238+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v589: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:45.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:45 smithi037 bash[13442]: cluster 2021-01-27T13:42:44.310159+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T13:42:45.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:45 smithi037 bash[13442]: cluster 2021-01-27T13:42:44.352238+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v589: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:46.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:46 smithi099 bash[9889]: cluster 2021-01-27T13:42:45.313644+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T13:42:46.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:46 smithi099 bash[9889]: cluster 2021-01-27T13:42:46.315190+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T13:42:46.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:46 smithi099 bash[9889]: audit 2021-01-27T13:42:46.318303+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? 172.21.15.37:0/4270534644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:46.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:46 smithi037 bash[9724]: cluster 2021-01-27T13:42:45.313644+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T13:42:46.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:46 smithi037 bash[9724]: cluster 2021-01-27T13:42:46.315190+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T13:42:46.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:46 smithi037 bash[9724]: audit 2021-01-27T13:42:46.318303+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? 172.21.15.37:0/4270534644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:46.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:46 smithi037 bash[13442]: cluster 2021-01-27T13:42:45.313644+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T13:42:46.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:46 smithi037 bash[13442]: cluster 2021-01-27T13:42:46.315190+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T13:42:46.825 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:46 smithi037 bash[13442]: audit 2021-01-27T13:42:46.318303+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? 172.21.15.37:0/4270534644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:47.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:47 smithi099 bash[9889]: cluster 2021-01-27T13:42:46.353027+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v592: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:47.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:47 smithi099 bash[9889]: audit 2021-01-27T13:42:47.317468+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? 172.21.15.37:0/4270534644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:47.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:47 smithi099 bash[9889]: cluster 2021-01-27T13:42:47.317651+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T13:42:47.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:47 smithi037 bash[9724]: cluster 2021-01-27T13:42:46.353027+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v592: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:47.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:47 smithi037 bash[9724]: audit 2021-01-27T13:42:47.317468+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? 172.21.15.37:0/4270534644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:47.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:47 smithi037 bash[9724]: cluster 2021-01-27T13:42:47.317651+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T13:42:47.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:47 smithi037 bash[13442]: cluster 2021-01-27T13:42:46.353027+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v592: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:47.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:47 smithi037 bash[13442]: audit 2021-01-27T13:42:47.317468+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? 172.21.15.37:0/4270534644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:47.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:47 smithi037 bash[13442]: cluster 2021-01-27T13:42:47.317651+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T13:42:48.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:42:48 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:42:48.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:42:48 smithi037 bash[9955]: debug 2021-01-27T13:42:48.010+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:42:48.326 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_list_snaps ... ok 2021-01-27T13:42:48.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:48 smithi099 bash[9889]: audit 2021-01-27T13:42:48.014487+0000 mgr.y (mgr.14138) 582 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:48.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:48 smithi099 bash[9889]: cluster 2021-01-27T13:42:48.322005+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T13:42:48.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:48 smithi037 bash[9724]: audit 2021-01-27T13:42:48.014487+0000 mgr.y (mgr.14138) 582 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:48.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:48 smithi037 bash[9724]: cluster 2021-01-27T13:42:48.322005+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T13:42:48.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:48 smithi037 bash[13442]: audit 2021-01-27T13:42:48.014487+0000 mgr.y (mgr.14138) 582 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:48.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:48 smithi037 bash[13442]: cluster 2021-01-27T13:42:48.322005+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T13:42:49.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:49 smithi099 bash[9889]: cluster 2021-01-27T13:42:48.354071+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v595: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:49.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:49 smithi037 bash[9724]: cluster 2021-01-27T13:42:48.354071+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v595: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:49.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:49 smithi037 bash[13442]: cluster 2021-01-27T13:42:48.354071+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v595: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:50.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:50 smithi099 bash[9889]: cluster 2021-01-27T13:42:49.357288+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T13:42:50.965 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:50 smithi099 bash[9889]: audit 2021-01-27T13:42:49.360848+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.37:0/558234951' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:50.965 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:50 smithi099 bash[9889]: audit 2021-01-27T13:42:49.361362+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:50.966 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:50 smithi037 bash[13442]: cluster 2021-01-27T13:42:49.357288+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T13:42:50.966 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:50 smithi037 bash[13442]: audit 2021-01-27T13:42:49.360848+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.37:0/558234951' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:50.967 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:50 smithi037 bash[13442]: audit 2021-01-27T13:42:49.361362+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:50.967 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:50 smithi037 bash[9724]: cluster 2021-01-27T13:42:49.357288+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T13:42:50.967 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:50 smithi037 bash[9724]: audit 2021-01-27T13:42:49.360848+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.37:0/558234951' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:50.968 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:50 smithi037 bash[9724]: audit 2021-01-27T13:42:49.361362+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:51.384 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_list_snaps_empty ... ok 2021-01-27T13:42:51.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:51 smithi099 bash[9889]: cluster 2021-01-27T13:42:50.355521+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v597: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:51.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:51 smithi099 bash[9889]: audit 2021-01-27T13:42:50.361084+0000 mon.a (mon.0) 1016 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:51.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:51 smithi099 bash[9889]: cluster 2021-01-27T13:42:50.361445+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T13:42:51.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:51 smithi037 bash[9724]: cluster 2021-01-27T13:42:50.355521+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v597: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:51.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:51 smithi037 bash[9724]: audit 2021-01-27T13:42:50.361084+0000 mon.a (mon.0) 1016 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:51.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:51 smithi037 bash[9724]: cluster 2021-01-27T13:42:50.361445+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T13:42:51.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:51 smithi037 bash[13442]: cluster 2021-01-27T13:42:50.355521+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v597: 212 pgs: 10 creating+peering, 22 unknown, 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:51.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:51 smithi037 bash[13442]: audit 2021-01-27T13:42:50.361084+0000 mon.a (mon.0) 1016 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:51.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:51 smithi037 bash[13442]: cluster 2021-01-27T13:42:50.361445+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T13:42:52.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:52 smithi099 bash[9889]: cluster 2021-01-27T13:42:51.380661+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T13:42:52.828 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:52 smithi037 bash[9724]: cluster 2021-01-27T13:42:51.380661+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T13:42:52.828 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:52 smithi037 bash[13442]: cluster 2021-01-27T13:42:51.380661+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T13:42:53.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:53 smithi099 bash[9889]: cluster 2021-01-27T13:42:52.356548+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v600: 180 pgs: 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:53.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:53 smithi099 bash[9889]: cluster 2021-01-27T13:42:52.399191+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T13:42:53.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:53 smithi037 bash[9724]: cluster 2021-01-27T13:42:52.356548+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v600: 180 pgs: 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:53.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:53 smithi037 bash[9724]: cluster 2021-01-27T13:42:52.399191+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T13:42:53.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:53 smithi037 bash[13442]: cluster 2021-01-27T13:42:52.356548+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v600: 180 pgs: 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:42:53.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:53 smithi037 bash[13442]: cluster 2021-01-27T13:42:52.399191+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T13:42:54.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:54 smithi099 bash[9889]: cluster 2021-01-27T13:42:53.405988+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T13:42:54.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:54 smithi099 bash[9889]: audit 2021-01-27T13:42:53.500298+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.37:0/3404690978' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:54.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:54 smithi037 bash[9724]: cluster 2021-01-27T13:42:53.405988+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T13:42:54.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:54 smithi037 bash[9724]: audit 2021-01-27T13:42:53.500298+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.37:0/3404690978' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:54.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:54 smithi037 bash[13442]: cluster 2021-01-27T13:42:53.405988+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T13:42:54.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:54 smithi037 bash[13442]: audit 2021-01-27T13:42:53.500298+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.37:0/3404690978' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:55.428 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_locator ... ok 2021-01-27T13:42:55.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:55 smithi099 bash[9889]: cluster 2021-01-27T13:42:54.357578+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v603: 212 pgs: 11 creating+peering, 17 unknown, 184 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:55.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:55 smithi099 bash[9889]: audit 2021-01-27T13:42:54.416118+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? 172.21.15.37:0/3404690978' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:55.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:55 smithi099 bash[9889]: cluster 2021-01-27T13:42:54.416236+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T13:42:55.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:55 smithi037 bash[9724]: cluster 2021-01-27T13:42:54.357578+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v603: 212 pgs: 11 creating+peering, 17 unknown, 184 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:55.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:55 smithi037 bash[9724]: audit 2021-01-27T13:42:54.416118+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? 172.21.15.37:0/3404690978' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:55.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:55 smithi037 bash[9724]: cluster 2021-01-27T13:42:54.416236+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T13:42:55.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:55 smithi037 bash[13442]: cluster 2021-01-27T13:42:54.357578+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v603: 212 pgs: 11 creating+peering, 17 unknown, 184 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:55.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:55 smithi037 bash[13442]: audit 2021-01-27T13:42:54.416118+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? 172.21.15.37:0/3404690978' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:55.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:55 smithi037 bash[13442]: cluster 2021-01-27T13:42:54.416236+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T13:42:56.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:56 smithi099 bash[9889]: cluster 2021-01-27T13:42:55.420427+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T13:42:56.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:56 smithi037 bash[9724]: cluster 2021-01-27T13:42:55.420427+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T13:42:56.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:56 smithi037 bash[13442]: cluster 2021-01-27T13:42:55.420427+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T13:42:57.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:57 smithi099 bash[9889]: cluster 2021-01-27T13:42:56.358495+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v606: 180 pgs: 180 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:57.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:57 smithi099 bash[9889]: cluster 2021-01-27T13:42:56.444525+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T13:42:57.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:57 smithi037 bash[9724]: cluster 2021-01-27T13:42:56.358495+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v606: 180 pgs: 180 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:57.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:57 smithi037 bash[9724]: cluster 2021-01-27T13:42:56.444525+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T13:42:57.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:57 smithi037 bash[13442]: cluster 2021-01-27T13:42:56.358495+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v606: 180 pgs: 180 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:57.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:57 smithi037 bash[13442]: cluster 2021-01-27T13:42:56.444525+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T13:42:58.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:42:58 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:42:58.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:42:58 smithi037 bash[9955]: debug 2021-01-27T13:42:58.018+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:42:58.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:58 smithi099 bash[9889]: cluster 2021-01-27T13:42:57.454322+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T13:42:58.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:58 smithi099 bash[9889]: audit 2021-01-27T13:42:57.508609+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? 172.21.15.37:0/2023476084' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:58.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:58 smithi099 bash[9889]: audit 2021-01-27T13:42:58.023724+0000 mgr.y (mgr.14138) 588 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:58.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:58 smithi037 bash[9724]: cluster 2021-01-27T13:42:57.454322+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T13:42:58.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:58 smithi037 bash[9724]: audit 2021-01-27T13:42:57.508609+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? 172.21.15.37:0/2023476084' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:58.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:58 smithi037 bash[9724]: audit 2021-01-27T13:42:58.023724+0000 mgr.y (mgr.14138) 588 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:58.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:58 smithi037 bash[13442]: cluster 2021-01-27T13:42:57.454322+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T13:42:58.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:58 smithi037 bash[13442]: audit 2021-01-27T13:42:57.508609+0000 mon.a (mon.0) 1027 : audit [INF] from='client.? 172.21.15.37:0/2023476084' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:42:58.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:58 smithi037 bash[13442]: audit 2021-01-27T13:42:58.023724+0000 mgr.y (mgr.14138) 588 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:42:59.471 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_lock ... ok 2021-01-27T13:42:59.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:59 smithi099 bash[9889]: cluster 2021-01-27T13:42:58.359744+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v609: 212 pgs: 2 creating+peering, 19 unknown, 191 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:59.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:59 smithi099 bash[9889]: audit 2021-01-27T13:42:58.464667+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.37:0/2023476084' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:59.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:42:59 smithi099 bash[9889]: cluster 2021-01-27T13:42:58.464927+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T13:42:59.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:59 smithi037 bash[9724]: cluster 2021-01-27T13:42:58.359744+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v609: 212 pgs: 2 creating+peering, 19 unknown, 191 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:59.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:59 smithi037 bash[9724]: audit 2021-01-27T13:42:58.464667+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.37:0/2023476084' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:59.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:42:59 smithi037 bash[9724]: cluster 2021-01-27T13:42:58.464927+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T13:42:59.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:59 smithi037 bash[13442]: cluster 2021-01-27T13:42:58.359744+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v609: 212 pgs: 2 creating+peering, 19 unknown, 191 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:42:59.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:59 smithi037 bash[13442]: audit 2021-01-27T13:42:58.464667+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.37:0/2023476084' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:42:59.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:42:59 smithi037 bash[13442]: cluster 2021-01-27T13:42:58.464927+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T13:43:00.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:00 smithi099 bash[9889]: cluster 2021-01-27T13:42:59.468766+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T13:43:00.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:00 smithi037 bash[9724]: cluster 2021-01-27T13:42:59.468766+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T13:43:00.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:00 smithi037 bash[13442]: cluster 2021-01-27T13:42:59.468766+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T13:43:01.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:01 smithi099 bash[9889]: cluster 2021-01-27T13:43:00.360860+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:01.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:01 smithi099 bash[9889]: cluster 2021-01-27T13:43:00.491760+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T13:43:01.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:01 smithi037 bash[13442]: cluster 2021-01-27T13:43:00.360860+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:01.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:01 smithi037 bash[13442]: cluster 2021-01-27T13:43:00.491760+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T13:43:01.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:01 smithi037 bash[9724]: cluster 2021-01-27T13:43:00.360860+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:01.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:01 smithi037 bash[9724]: cluster 2021-01-27T13:43:00.491760+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T13:43:02.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:02 smithi099 bash[9889]: cluster 2021-01-27T13:43:01.499496+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T13:43:02.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:02 smithi099 bash[9889]: audit 2021-01-27T13:43:01.501440+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.37:0/36263889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:02.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:02 smithi099 bash[9889]: audit 2021-01-27T13:43:01.511782+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:02.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:02 smithi037 bash[9724]: cluster 2021-01-27T13:43:01.499496+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T13:43:02.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:02 smithi037 bash[9724]: audit 2021-01-27T13:43:01.501440+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.37:0/36263889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:02.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:02 smithi037 bash[9724]: audit 2021-01-27T13:43:01.511782+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:02.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:02 smithi037 bash[13442]: cluster 2021-01-27T13:43:01.499496+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T13:43:02.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:02 smithi037 bash[13442]: audit 2021-01-27T13:43:01.501440+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.37:0/36263889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:02.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:02 smithi037 bash[13442]: audit 2021-01-27T13:43:01.511782+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:03.535 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_lookup_snap ... ok 2021-01-27T13:43:03.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:03 smithi099 bash[9889]: cluster 2021-01-27T13:43:02.361868+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v615: 212 pgs: 7 creating+peering, 23 unknown, 182 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:03.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:03 smithi099 bash[9889]: audit 2021-01-27T13:43:02.519805+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:03.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:03 smithi099 bash[9889]: cluster 2021-01-27T13:43:02.519938+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T13:43:03.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:03 smithi037 bash[9724]: cluster 2021-01-27T13:43:02.361868+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v615: 212 pgs: 7 creating+peering, 23 unknown, 182 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:03.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:03 smithi037 bash[9724]: audit 2021-01-27T13:43:02.519805+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:03.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:03 smithi037 bash[9724]: cluster 2021-01-27T13:43:02.519938+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T13:43:03.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:03 smithi037 bash[13442]: cluster 2021-01-27T13:43:02.361868+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v615: 212 pgs: 7 creating+peering, 23 unknown, 182 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:03.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:03 smithi037 bash[13442]: audit 2021-01-27T13:43:02.519805+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:03.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:03 smithi037 bash[13442]: cluster 2021-01-27T13:43:02.519938+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T13:43:04.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:04 smithi099 bash[9889]: cluster 2021-01-27T13:43:03.531383+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T13:43:04.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:04 smithi037 bash[9724]: cluster 2021-01-27T13:43:03.531383+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T13:43:04.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:04 smithi037 bash[13442]: cluster 2021-01-27T13:43:03.531383+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T13:43:05.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:05 smithi037 bash[9724]: cluster 2021-01-27T13:43:04.362858+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v618: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:05.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:05 smithi037 bash[9724]: cluster 2021-01-27T13:43:04.547546+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T13:43:05.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:05 smithi037 bash[13442]: cluster 2021-01-27T13:43:04.362858+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v618: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:05.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:05 smithi037 bash[13442]: cluster 2021-01-27T13:43:04.547546+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T13:43:06.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:05 smithi099 bash[9889]: cluster 2021-01-27T13:43:04.362858+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v618: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:06.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:05 smithi099 bash[9889]: cluster 2021-01-27T13:43:04.547546+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T13:43:07.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:06 smithi099 bash[9889]: cluster 2021-01-27T13:43:05.557474+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T13:43:07.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:06 smithi099 bash[9889]: audit 2021-01-27T13:43:05.632347+0000 mon.a (mon.0) 1039 : audit [INF] from='client.? 172.21.15.37:0/675978617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:07.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:06 smithi037 bash[9724]: cluster 2021-01-27T13:43:05.557474+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T13:43:07.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:06 smithi037 bash[9724]: audit 2021-01-27T13:43:05.632347+0000 mon.a (mon.0) 1039 : audit [INF] from='client.? 172.21.15.37:0/675978617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:07.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:06 smithi037 bash[13442]: cluster 2021-01-27T13:43:05.557474+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T13:43:07.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:06 smithi037 bash[13442]: audit 2021-01-27T13:43:05.632347+0000 mon.a (mon.0) 1039 : audit [INF] from='client.? 172.21.15.37:0/675978617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:07.580 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_obj_xattrs ... ok 2021-01-27T13:43:08.034 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:07 smithi037 bash[9724]: cluster 2021-01-27T13:43:06.363875+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v621: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:08.034 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:07 smithi037 bash[9724]: audit 2021-01-27T13:43:06.576309+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.37:0/675978617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:08.034 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:07 smithi037 bash[9724]: cluster 2021-01-27T13:43:06.576651+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T13:43:08.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:07 smithi037 bash[9724]: cluster 2021-01-27T13:43:07.578702+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T13:43:08.035 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:07 smithi037 bash[13442]: cluster 2021-01-27T13:43:06.363875+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v621: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:08.035 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:07 smithi037 bash[13442]: audit 2021-01-27T13:43:06.576309+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.37:0/675978617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:08.035 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:07 smithi037 bash[13442]: cluster 2021-01-27T13:43:06.576651+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T13:43:08.035 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:07 smithi037 bash[13442]: cluster 2021-01-27T13:43:07.578702+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T13:43:08.036 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:07 smithi099 bash[9889]: cluster 2021-01-27T13:43:06.363875+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v621: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:08.036 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:07 smithi099 bash[9889]: audit 2021-01-27T13:43:06.576309+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.37:0/675978617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:08.036 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:07 smithi099 bash[9889]: cluster 2021-01-27T13:43:06.576651+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T13:43:08.037 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:07 smithi099 bash[9889]: cluster 2021-01-27T13:43:07.578702+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T13:43:08.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:43:08 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:43:08.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:43:08 smithi037 bash[9955]: debug 2021-01-27T13:43:08.030+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:43:09.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:08 smithi099 bash[9889]: audit 2021-01-27T13:43:08.034905+0000 mgr.y (mgr.14138) 594 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:09.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:08 smithi037 bash[9724]: audit 2021-01-27T13:43:08.034905+0000 mgr.y (mgr.14138) 594 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:09.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:08 smithi037 bash[13442]: audit 2021-01-27T13:43:08.034905+0000 mgr.y (mgr.14138) 594 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:10.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:09 smithi099 bash[9889]: cluster 2021-01-27T13:43:08.365060+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v624: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:10.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:09 smithi099 bash[9889]: cluster 2021-01-27T13:43:08.604824+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T13:43:10.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:09 smithi037 bash[9724]: cluster 2021-01-27T13:43:08.365060+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v624: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:10.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:09 smithi037 bash[9724]: cluster 2021-01-27T13:43:08.604824+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T13:43:10.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:09 smithi037 bash[13442]: cluster 2021-01-27T13:43:08.365060+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v624: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:10.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:09 smithi037 bash[13442]: cluster 2021-01-27T13:43:08.604824+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T13:43:11.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:10 smithi099 bash[9889]: cluster 2021-01-27T13:43:09.615944+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T13:43:11.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:10 smithi099 bash[9889]: audit 2021-01-27T13:43:09.652321+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.37:0/2413928955' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:11.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:10 smithi099 bash[9889]: audit 2021-01-27T13:43:09.652991+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:11.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:10 smithi037 bash[9724]: cluster 2021-01-27T13:43:09.615944+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T13:43:11.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:10 smithi037 bash[9724]: audit 2021-01-27T13:43:09.652321+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.37:0/2413928955' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:11.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:10 smithi037 bash[9724]: audit 2021-01-27T13:43:09.652991+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:11.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:10 smithi037 bash[13442]: cluster 2021-01-27T13:43:09.615944+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T13:43:11.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:10 smithi037 bash[13442]: audit 2021-01-27T13:43:09.652321+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.37:0/2413928955' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:11.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:10 smithi037 bash[13442]: audit 2021-01-27T13:43:09.652991+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:11.630 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_operate_aio_write_op ... ok 2021-01-27T13:43:12.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:11 smithi099 bash[9889]: cluster 2021-01-27T13:43:10.366253+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v627: 212 pgs: 3 creating+peering, 21 unknown, 188 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:12.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:11 smithi099 bash[9889]: audit 2021-01-27T13:43:10.624115+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:12.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:11 smithi099 bash[9889]: cluster 2021-01-27T13:43:10.624964+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T13:43:12.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:11 smithi099 bash[9889]: cluster 2021-01-27T13:43:11.624624+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T13:43:12.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:11 smithi037 bash[9724]: cluster 2021-01-27T13:43:10.366253+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v627: 212 pgs: 3 creating+peering, 21 unknown, 188 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:12.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:11 smithi037 bash[9724]: audit 2021-01-27T13:43:10.624115+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:12.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:11 smithi037 bash[9724]: cluster 2021-01-27T13:43:10.624964+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T13:43:12.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:11 smithi037 bash[9724]: cluster 2021-01-27T13:43:11.624624+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T13:43:12.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:11 smithi037 bash[13442]: cluster 2021-01-27T13:43:10.366253+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v627: 212 pgs: 3 creating+peering, 21 unknown, 188 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:12.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:11 smithi037 bash[13442]: audit 2021-01-27T13:43:10.624115+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:12.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:11 smithi037 bash[13442]: cluster 2021-01-27T13:43:10.624964+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T13:43:12.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:11 smithi037 bash[13442]: cluster 2021-01-27T13:43:11.624624+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T13:43:14.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:13 smithi099 bash[9889]: cluster 2021-01-27T13:43:12.367186+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v630: 180 pgs: 180 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:14.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:13 smithi099 bash[9889]: cluster 2021-01-27T13:43:12.646157+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T13:43:14.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:13 smithi037 bash[13442]: cluster 2021-01-27T13:43:12.367186+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v630: 180 pgs: 180 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:14.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:13 smithi037 bash[13442]: cluster 2021-01-27T13:43:12.646157+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T13:43:14.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:13 smithi037 bash[9724]: cluster 2021-01-27T13:43:12.367186+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v630: 180 pgs: 180 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:14.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:13 smithi037 bash[9724]: cluster 2021-01-27T13:43:12.646157+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T13:43:15.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:14 smithi099 bash[9889]: cluster 2021-01-27T13:43:13.647607+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T13:43:15.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:14 smithi099 bash[9889]: audit 2021-01-27T13:43:13.687188+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.37:0/2542062005' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:15.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:14 smithi099 bash[9889]: audit 2021-01-27T13:43:13.687598+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:15.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:14 smithi099 bash[9889]: audit 2021-01-27T13:43:14.348426+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:43:15.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:14 smithi099 bash[9889]: audit 2021-01-27T13:43:14.349032+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:43:15.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[9724]: cluster 2021-01-27T13:43:13.647607+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T13:43:15.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[9724]: audit 2021-01-27T13:43:13.687188+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.37:0/2542062005' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:15.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[9724]: audit 2021-01-27T13:43:13.687598+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:15.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[9724]: audit 2021-01-27T13:43:14.348426+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:43:15.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[9724]: audit 2021-01-27T13:43:14.349032+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:43:15.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[13442]: cluster 2021-01-27T13:43:13.647607+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T13:43:15.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[13442]: audit 2021-01-27T13:43:13.687188+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.37:0/2542062005' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:15.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[13442]: audit 2021-01-27T13:43:13.687598+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:15.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[13442]: audit 2021-01-27T13:43:14.348426+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T13:43:15.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:14 smithi037 bash[13442]: audit 2021-01-27T13:43:14.349032+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14138 172.21.15.37:0/3991133395' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T13:43:15.686 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_remove_omap_ramge2 ... ok 2021-01-27T13:43:16.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:15 smithi099 bash[9889]: cluster 2021-01-27T13:43:14.368201+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v633: 212 pgs: 16 creating+peering, 15 unknown, 181 active+clean; 25 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:16.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:15 smithi099 bash[9889]: audit 2021-01-27T13:43:14.671838+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:16.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:15 smithi099 bash[9889]: cluster 2021-01-27T13:43:14.672229+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T13:43:16.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:15 smithi037 bash[9724]: cluster 2021-01-27T13:43:14.368201+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v633: 212 pgs: 16 creating+peering, 15 unknown, 181 active+clean; 25 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:16.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:15 smithi037 bash[9724]: audit 2021-01-27T13:43:14.671838+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:16.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:15 smithi037 bash[9724]: cluster 2021-01-27T13:43:14.672229+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T13:43:16.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:15 smithi037 bash[13442]: cluster 2021-01-27T13:43:14.368201+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v633: 212 pgs: 16 creating+peering, 15 unknown, 181 active+clean; 25 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:16.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:15 smithi037 bash[13442]: audit 2021-01-27T13:43:14.671838+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:16.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:15 smithi037 bash[13442]: cluster 2021-01-27T13:43:14.672229+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T13:43:17.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:16 smithi099 bash[9889]: cluster 2021-01-27T13:43:15.673711+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T13:43:17.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:16 smithi037 bash[9724]: cluster 2021-01-27T13:43:15.673711+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T13:43:17.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:16 smithi037 bash[13442]: cluster 2021-01-27T13:43:15.673711+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T13:43:18.040 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:17 smithi037 bash[9724]: cluster 2021-01-27T13:43:16.369113+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v636: 180 pgs: 180 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:18.041 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:17 smithi037 bash[9724]: cluster 2021-01-27T13:43:16.700193+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T13:43:18.041 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:17 smithi037 bash[13442]: cluster 2021-01-27T13:43:16.369113+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v636: 180 pgs: 180 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:18.041 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:17 smithi037 bash[13442]: cluster 2021-01-27T13:43:16.700193+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T13:43:18.042 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:17 smithi099 bash[9889]: cluster 2021-01-27T13:43:16.369113+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v636: 180 pgs: 180 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:18.042 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:17 smithi099 bash[9889]: cluster 2021-01-27T13:43:16.700193+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T13:43:18.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:43:18 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:43:18.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:43:18 smithi037 bash[9955]: debug 2021-01-27T13:43:18.034+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:43:19.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:18 smithi099 bash[9889]: cluster 2021-01-27T13:43:17.709848+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T13:43:19.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:18 smithi099 bash[9889]: audit 2021-01-27T13:43:18.041466+0000 mgr.y (mgr.14138) 600 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:19.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:18 smithi037 bash[9724]: cluster 2021-01-27T13:43:17.709848+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T13:43:19.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:18 smithi037 bash[9724]: audit 2021-01-27T13:43:18.041466+0000 mgr.y (mgr.14138) 600 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:19.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:18 smithi037 bash[13442]: cluster 2021-01-27T13:43:17.709848+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T13:43:19.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:18 smithi037 bash[13442]: audit 2021-01-27T13:43:18.041466+0000 mgr.y (mgr.14138) 600 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:20.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:19 smithi099 bash[9889]: cluster 2021-01-27T13:43:18.370371+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v639: 212 pgs: 21 unknown, 191 active+clean; 25 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:20.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:19 smithi099 bash[9889]: cluster 2021-01-27T13:43:18.720880+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T13:43:20.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:19 smithi099 bash[9889]: audit 2021-01-27T13:43:18.726779+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.37:0/1227815966' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:20.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:19 smithi099 bash[9889]: audit 2021-01-27T13:43:18.727234+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:20.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:19 smithi037 bash[13442]: cluster 2021-01-27T13:43:18.370371+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v639: 212 pgs: 21 unknown, 191 active+clean; 25 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:20.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:19 smithi037 bash[13442]: cluster 2021-01-27T13:43:18.720880+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T13:43:20.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:19 smithi037 bash[13442]: audit 2021-01-27T13:43:18.726779+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.37:0/1227815966' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:20.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:19 smithi037 bash[13442]: audit 2021-01-27T13:43:18.727234+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:20.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:19 smithi037 bash[9724]: cluster 2021-01-27T13:43:18.370371+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v639: 212 pgs: 21 unknown, 191 active+clean; 25 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:19 smithi037 bash[9724]: cluster 2021-01-27T13:43:18.720880+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T13:43:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:19 smithi037 bash[9724]: audit 2021-01-27T13:43:18.726779+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.37:0/1227815966' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:19 smithi037 bash[9724]: audit 2021-01-27T13:43:18.727234+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:20.734 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_remove_snap ... ok 2021-01-27T13:43:21.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:20 smithi099 bash[9889]: audit 2021-01-27T13:43:19.723014+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:21.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:20 smithi099 bash[9889]: cluster 2021-01-27T13:43:19.723168+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T13:43:21.062 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:20 smithi099 bash[9889]: cluster 2021-01-27T13:43:20.729970+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T13:43:21.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:20 smithi037 bash[9724]: audit 2021-01-27T13:43:19.723014+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:21.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:20 smithi037 bash[9724]: cluster 2021-01-27T13:43:19.723168+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T13:43:21.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:20 smithi037 bash[9724]: cluster 2021-01-27T13:43:20.729970+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T13:43:21.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:20 smithi037 bash[13442]: audit 2021-01-27T13:43:19.723014+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:21.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:20 smithi037 bash[13442]: cluster 2021-01-27T13:43:19.723168+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T13:43:21.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:20 smithi037 bash[13442]: cluster 2021-01-27T13:43:20.729970+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T13:43:22.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:21 smithi099 bash[9889]: cluster 2021-01-27T13:43:20.371561+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v642: 212 pgs: 12 unknown, 200 active+clean; 25 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:22.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:21 smithi037 bash[9724]: cluster 2021-01-27T13:43:20.371561+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v642: 212 pgs: 12 unknown, 200 active+clean; 25 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:22.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:21 smithi037 bash[13442]: cluster 2021-01-27T13:43:20.371561+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v642: 212 pgs: 12 unknown, 200 active+clean; 25 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:23.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:22 smithi099 bash[9889]: cluster 2021-01-27T13:43:21.756274+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T13:43:23.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:22 smithi099 bash[9889]: audit 2021-01-27T13:43:21.764062+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.37:0/1740685038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:23.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:22 smithi037 bash[9724]: cluster 2021-01-27T13:43:21.756274+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T13:43:23.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:22 smithi037 bash[9724]: audit 2021-01-27T13:43:21.764062+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.37:0/1740685038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:23.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:22 smithi037 bash[13442]: cluster 2021-01-27T13:43:21.756274+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T13:43:23.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:22 smithi037 bash[13442]: audit 2021-01-27T13:43:21.764062+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.37:0/1740685038' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:23.780 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_service_daemon ... ok 2021-01-27T13:43:24.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:23 smithi099 bash[9889]: cluster 2021-01-27T13:43:22.372389+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v645: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:24.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:23 smithi099 bash[9889]: audit 2021-01-27T13:43:22.771077+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.37:0/1740685038' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:24.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:23 smithi099 bash[9889]: cluster 2021-01-27T13:43:22.771436+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T13:43:24.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:23 smithi037 bash[13442]: cluster 2021-01-27T13:43:22.372389+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v645: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:24.072 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:23 smithi037 bash[13442]: audit 2021-01-27T13:43:22.771077+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.37:0/1740685038' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:24.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:23 smithi037 bash[13442]: cluster 2021-01-27T13:43:22.771436+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T13:43:24.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:23 smithi037 bash[9724]: cluster 2021-01-27T13:43:22.372389+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v645: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:24.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:23 smithi037 bash[9724]: audit 2021-01-27T13:43:22.771077+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.37:0/1740685038' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:24.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:23 smithi037 bash[9724]: cluster 2021-01-27T13:43:22.771436+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T13:43:25.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:24 smithi099 bash[9889]: cluster 2021-01-27T13:43:23.776478+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T13:43:25.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:24 smithi037 bash[9724]: cluster 2021-01-27T13:43:23.776478+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T13:43:25.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:24 smithi037 bash[13442]: cluster 2021-01-27T13:43:23.776478+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T13:43:26.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:25 smithi099 bash[9889]: cluster 2021-01-27T13:43:24.373339+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v648: 180 pgs: 180 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:26.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:25 smithi099 bash[9889]: cluster 2021-01-27T13:43:24.783816+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T13:43:26.061 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:25 smithi099 bash[9889]: cluster 2021-01-27T13:43:25.785784+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T13:43:26.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:25 smithi037 bash[9724]: cluster 2021-01-27T13:43:24.373339+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v648: 180 pgs: 180 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:26.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:25 smithi037 bash[9724]: cluster 2021-01-27T13:43:24.783816+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T13:43:26.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:25 smithi037 bash[9724]: cluster 2021-01-27T13:43:25.785784+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T13:43:26.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:25 smithi037 bash[13442]: cluster 2021-01-27T13:43:24.373339+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v648: 180 pgs: 180 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:26.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:25 smithi037 bash[13442]: cluster 2021-01-27T13:43:24.783816+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T13:43:26.073 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:25 smithi037 bash[13442]: cluster 2021-01-27T13:43:25.785784+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T13:43:27.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:26 smithi037 bash[9724]: audit 2021-01-27T13:43:25.826272+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.37:0/3933144772' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:27.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:26 smithi037 bash[9724]: audit 2021-01-27T13:43:25.826621+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:27.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:26 smithi037 bash[13442]: audit 2021-01-27T13:43:25.826272+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.37:0/3933144772' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:27.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:26 smithi037 bash[13442]: audit 2021-01-27T13:43:25.826621+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:27.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:26 smithi099 bash[9889]: audit 2021-01-27T13:43:25.826272+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.37:0/3933144772' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:27.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:26 smithi099 bash[9889]: audit 2021-01-27T13:43:25.826621+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:27.840 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_set_omap ... ok 2021-01-27T13:43:28.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:27 smithi037 bash[9724]: cluster 2021-01-27T13:43:26.374392+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v651: 212 pgs: 8 creating+peering, 19 unknown, 185 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2021-01-27T13:43:28.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:27 smithi037 bash[9724]: cluster 2021-01-27T13:43:26.801092+0000 mon.a (mon.0) 1072 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:43:28.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:27 smithi037 bash[9724]: audit 2021-01-27T13:43:26.819011+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:28.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:27 smithi037 bash[9724]: cluster 2021-01-27T13:43:26.819120+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T13:43:28.074 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:43:28 smithi037 bash[9955]: debug 2021-01-27T13:43:28.038+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:43:28.074 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:27 smithi037 bash[13442]: cluster 2021-01-27T13:43:26.374392+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v651: 212 pgs: 8 creating+peering, 19 unknown, 185 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2021-01-27T13:43:28.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:27 smithi037 bash[13442]: cluster 2021-01-27T13:43:26.801092+0000 mon.a (mon.0) 1072 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:43:28.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:27 smithi037 bash[13442]: audit 2021-01-27T13:43:26.819011+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:28.075 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:27 smithi037 bash[13442]: cluster 2021-01-27T13:43:26.819120+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T13:43:28.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:43:28 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:43:28.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:27 smithi099 bash[9889]: cluster 2021-01-27T13:43:26.374392+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v651: 212 pgs: 8 creating+peering, 19 unknown, 185 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2021-01-27T13:43:28.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:27 smithi099 bash[9889]: cluster 2021-01-27T13:43:26.801092+0000 mon.a (mon.0) 1072 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:43:28.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:27 smithi099 bash[9889]: audit 2021-01-27T13:43:26.819011+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:28.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:27 smithi099 bash[9889]: cluster 2021-01-27T13:43:26.819120+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T13:43:29.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:28 smithi099 bash[9889]: cluster 2021-01-27T13:43:27.834226+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T13:43:29.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:28 smithi099 bash[9889]: audit 2021-01-27T13:43:28.043769+0000 mgr.y (mgr.14138) 606 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:28 smithi037 bash[9724]: cluster 2021-01-27T13:43:27.834226+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T13:43:29.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:28 smithi037 bash[9724]: audit 2021-01-27T13:43:28.043769+0000 mgr.y (mgr.14138) 606 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:29.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:28 smithi037 bash[13442]: cluster 2021-01-27T13:43:27.834226+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T13:43:29.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:28 smithi037 bash[13442]: audit 2021-01-27T13:43:28.043769+0000 mgr.y (mgr.14138) 606 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:30.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:29 smithi099 bash[9889]: cluster 2021-01-27T13:43:28.375574+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v654: 180 pgs: 180 active+clean; 25 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:30.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:29 smithi099 bash[9889]: cluster 2021-01-27T13:43:28.824857+0000 mon.a (mon.0) 1076 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:43:30.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:29 smithi099 bash[9889]: cluster 2021-01-27T13:43:28.824947+0000 mon.a (mon.0) 1077 : cluster [INF] Cluster is now healthy 2021-01-27T13:43:30.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:29 smithi099 bash[9889]: cluster 2021-01-27T13:43:28.849738+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T13:43:30.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:29 smithi037 bash[9724]: cluster 2021-01-27T13:43:28.375574+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v654: 180 pgs: 180 active+clean; 25 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:29 smithi037 bash[9724]: cluster 2021-01-27T13:43:28.824857+0000 mon.a (mon.0) 1076 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:43:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:29 smithi037 bash[9724]: cluster 2021-01-27T13:43:28.824947+0000 mon.a (mon.0) 1077 : cluster [INF] Cluster is now healthy 2021-01-27T13:43:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:29 smithi037 bash[9724]: cluster 2021-01-27T13:43:28.849738+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T13:43:30.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:29 smithi037 bash[13442]: cluster 2021-01-27T13:43:28.375574+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v654: 180 pgs: 180 active+clean; 25 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:30.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:29 smithi037 bash[13442]: cluster 2021-01-27T13:43:28.824857+0000 mon.a (mon.0) 1076 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:43:30.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:29 smithi037 bash[13442]: cluster 2021-01-27T13:43:28.824947+0000 mon.a (mon.0) 1077 : cluster [INF] Cluster is now healthy 2021-01-27T13:43:30.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:29 smithi037 bash[13442]: cluster 2021-01-27T13:43:28.849738+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T13:43:31.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:30 smithi099 bash[9889]: cluster 2021-01-27T13:43:29.846292+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T13:43:31.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:30 smithi099 bash[9889]: audit 2021-01-27T13:43:29.884534+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.37:0/3328135937' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:31.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:30 smithi037 bash[9724]: cluster 2021-01-27T13:43:29.846292+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T13:43:31.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:30 smithi037 bash[9724]: audit 2021-01-27T13:43:29.884534+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.37:0/3328135937' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:31.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:30 smithi037 bash[13442]: cluster 2021-01-27T13:43:29.846292+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T13:43:31.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:30 smithi037 bash[13442]: audit 2021-01-27T13:43:29.884534+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.37:0/3328135937' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:31.877 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_set_omap_aio ... ok 2021-01-27T13:43:32.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:31 smithi099 bash[9889]: cluster 2021-01-27T13:43:30.376824+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v657: 212 pgs: 8 creating+peering, 17 unknown, 187 active+clean; 25 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-27T13:43:32.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:31 smithi099 bash[9889]: audit 2021-01-27T13:43:30.867201+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.37:0/3328135937' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:32.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:31 smithi099 bash[9889]: cluster 2021-01-27T13:43:30.867428+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T13:43:32.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:31 smithi037 bash[13442]: cluster 2021-01-27T13:43:30.376824+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v657: 212 pgs: 8 creating+peering, 17 unknown, 187 active+clean; 25 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-27T13:43:32.322 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:31 smithi037 bash[13442]: audit 2021-01-27T13:43:30.867201+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.37:0/3328135937' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:32.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:31 smithi037 bash[13442]: cluster 2021-01-27T13:43:30.867428+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T13:43:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:31 smithi037 bash[9724]: cluster 2021-01-27T13:43:30.376824+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v657: 212 pgs: 8 creating+peering, 17 unknown, 187 active+clean; 25 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-27T13:43:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:31 smithi037 bash[9724]: audit 2021-01-27T13:43:30.867201+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.37:0/3328135937' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:31 smithi037 bash[9724]: cluster 2021-01-27T13:43:30.867428+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T13:43:33.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:32 smithi099 bash[9889]: cluster 2021-01-27T13:43:31.873001+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T13:43:33.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:32 smithi037 bash[9724]: cluster 2021-01-27T13:43:31.873001+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T13:43:33.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:32 smithi037 bash[13442]: cluster 2021-01-27T13:43:31.873001+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T13:43:34.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:33 smithi099 bash[9889]: cluster 2021-01-27T13:43:32.377524+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v660: 180 pgs: 180 active+clean; 25 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:34.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:33 smithi099 bash[9889]: cluster 2021-01-27T13:43:32.907557+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T13:43:34.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:33 smithi037 bash[9724]: cluster 2021-01-27T13:43:32.377524+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v660: 180 pgs: 180 active+clean; 25 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:34.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:33 smithi037 bash[9724]: cluster 2021-01-27T13:43:32.907557+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T13:43:34.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:33 smithi037 bash[13442]: cluster 2021-01-27T13:43:32.377524+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v660: 180 pgs: 180 active+clean; 25 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:34.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:33 smithi037 bash[13442]: cluster 2021-01-27T13:43:32.907557+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T13:43:35.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:34 smithi099 bash[9889]: cluster 2021-01-27T13:43:33.912984+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T13:43:35.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:34 smithi037 bash[9724]: cluster 2021-01-27T13:43:33.912984+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T13:43:35.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:34 smithi037 bash[13442]: cluster 2021-01-27T13:43:33.912984+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T13:43:36.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:35 smithi099 bash[9889]: cluster 2021-01-27T13:43:34.378552+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v663: 212 pgs: 6 creating+peering, 24 unknown, 182 active+clean; 25 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:36.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:35 smithi099 bash[9889]: cluster 2021-01-27T13:43:34.934603+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T13:43:36.312 INFO:journalctl@ceph.osd.5.smithi099.stdout:Jan 27 13:43:35 smithi099 bash[15271]: debug 2021-01-27T13:43:35.953+0000 7fa099f70700 -1 osd.5 pg_epoch: 275 pg[54.10( v 274'3 (0'0,274'3] local-lis/les=272/273 n=2 ec=272/272 lis/c=272/272 les/c/f=273/273/0 sis=272) [5,2,0] r=0 lpr=272 crt=274'3 lcod 273'1 mlcod 273'1 active+clean+snaptrim trimq=[1~1]] removing snap head 2021-01-27T13:43:36.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:35 smithi037 bash[9724]: cluster 2021-01-27T13:43:34.378552+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v663: 212 pgs: 6 creating+peering, 24 unknown, 182 active+clean; 25 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:36.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:35 smithi037 bash[9724]: cluster 2021-01-27T13:43:34.934603+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T13:43:36.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:35 smithi037 bash[13442]: cluster 2021-01-27T13:43:34.378552+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v663: 212 pgs: 6 creating+peering, 24 unknown, 182 active+clean; 25 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:36.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:35 smithi037 bash[13442]: cluster 2021-01-27T13:43:34.934603+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T13:43:37.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:36 smithi099 bash[9889]: cluster 2021-01-27T13:43:35.958038+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T13:43:37.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:36 smithi099 bash[9889]: audit 2021-01-27T13:43:35.969518+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.37:0/539983876' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:37.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:36 smithi099 bash[9889]: audit 2021-01-27T13:43:35.970003+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:37.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:36 smithi037 bash[9724]: cluster 2021-01-27T13:43:35.958038+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T13:43:37.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:36 smithi037 bash[9724]: audit 2021-01-27T13:43:35.969518+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.37:0/539983876' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:37.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:36 smithi037 bash[9724]: audit 2021-01-27T13:43:35.970003+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:37.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:36 smithi037 bash[13442]: cluster 2021-01-27T13:43:35.958038+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T13:43:37.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:36 smithi037 bash[13442]: audit 2021-01-27T13:43:35.969518+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.37:0/539983876' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:37.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:36 smithi037 bash[13442]: audit 2021-01-27T13:43:35.970003+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:37.967 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_snap_read ... ok 2021-01-27T13:43:38.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:43:38 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:43:38.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:37 smithi099 bash[9889]: cluster 2021-01-27T13:43:36.379629+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v666: 212 pgs: 6 creating+peering, 5 unknown, 201 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:38.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:37 smithi099 bash[9889]: audit 2021-01-27T13:43:36.960674+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:38.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:37 smithi099 bash[9889]: cluster 2021-01-27T13:43:36.960920+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T13:43:38.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:37 smithi099 bash[9889]: cluster 2021-01-27T13:43:37.965246+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T13:43:38.322 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:43:38 smithi037 bash[9955]: debug 2021-01-27T13:43:38.046+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:43:38.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:37 smithi037 bash[13442]: cluster 2021-01-27T13:43:36.379629+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v666: 212 pgs: 6 creating+peering, 5 unknown, 201 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:38.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:37 smithi037 bash[13442]: audit 2021-01-27T13:43:36.960674+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:38.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:37 smithi037 bash[13442]: cluster 2021-01-27T13:43:36.960920+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T13:43:38.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:37 smithi037 bash[13442]: cluster 2021-01-27T13:43:37.965246+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T13:43:38.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:37 smithi037 bash[9724]: cluster 2021-01-27T13:43:36.379629+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v666: 212 pgs: 6 creating+peering, 5 unknown, 201 active+clean; 25 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:38.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:37 smithi037 bash[9724]: audit 2021-01-27T13:43:36.960674+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:38.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:37 smithi037 bash[9724]: cluster 2021-01-27T13:43:36.960920+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T13:43:38.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:37 smithi037 bash[9724]: cluster 2021-01-27T13:43:37.965246+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T13:43:39.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:38 smithi099 bash[9889]: audit 2021-01-27T13:43:38.051712+0000 mgr.y (mgr.14138) 612 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:39.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:38 smithi037 bash[9724]: audit 2021-01-27T13:43:38.051712+0000 mgr.y (mgr.14138) 612 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:39.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:38 smithi037 bash[13442]: audit 2021-01-27T13:43:38.051712+0000 mgr.y (mgr.14138) 612 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:40.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:39 smithi099 bash[9889]: cluster 2021-01-27T13:43:38.380632+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v669: 180 pgs: 180 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:40.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:39 smithi099 bash[9889]: cluster 2021-01-27T13:43:38.994014+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T13:43:40.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:39 smithi037 bash[9724]: cluster 2021-01-27T13:43:38.380632+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v669: 180 pgs: 180 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:40.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:39 smithi037 bash[9724]: cluster 2021-01-27T13:43:38.994014+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T13:43:40.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:39 smithi037 bash[13442]: cluster 2021-01-27T13:43:38.380632+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v669: 180 pgs: 180 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:40.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:39 smithi037 bash[13442]: cluster 2021-01-27T13:43:38.994014+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T13:43:41.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:41 smithi099 bash[9889]: cluster 2021-01-27T13:43:40.009194+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T13:43:41.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:41 smithi037 bash[9724]: cluster 2021-01-27T13:43:40.009194+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T13:43:41.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:41 smithi037 bash[13442]: cluster 2021-01-27T13:43:40.009194+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T13:43:42.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:42 smithi099 bash[9889]: cluster 2021-01-27T13:43:40.381877+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v672: 212 pgs: 4 creating+peering, 17 unknown, 191 active+clean; 25 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:43:42.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:42 smithi099 bash[9889]: cluster 2021-01-27T13:43:41.000168+0000 mon.a (mon.0) 1094 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:43:42.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:42 smithi099 bash[9889]: cluster 2021-01-27T13:43:41.018346+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T13:43:42.323 INFO:journalctl@ceph.osd.3.smithi037.stdout:Jan 27 13:43:42 smithi037 bash[24020]: debug 2021-01-27T13:43:42.034+0000 7ff89ca64700 -1 osd.3 pg_epoch: 281 pg[55.10( v 281'5 (0'0,281'5] local-lis/les=278/279 n=2 ec=278/278 lis/c=278/278 les/c/f=279/279/0 sis=278) [3,2,7] r=0 lpr=278 luod=280'4 crt=281'5 lcod 280'3 mlcod 280'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2021-01-27T13:43:42.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:42 smithi037 bash[9724]: cluster 2021-01-27T13:43:40.381877+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v672: 212 pgs: 4 creating+peering, 17 unknown, 191 active+clean; 25 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:43:42.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:42 smithi037 bash[9724]: cluster 2021-01-27T13:43:41.000168+0000 mon.a (mon.0) 1094 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:43:42.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:42 smithi037 bash[9724]: cluster 2021-01-27T13:43:41.018346+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T13:43:42.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:42 smithi037 bash[13442]: cluster 2021-01-27T13:43:40.381877+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v672: 212 pgs: 4 creating+peering, 17 unknown, 191 active+clean; 25 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T13:43:42.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:42 smithi037 bash[13442]: cluster 2021-01-27T13:43:41.000168+0000 mon.a (mon.0) 1094 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T13:43:42.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:42 smithi037 bash[13442]: cluster 2021-01-27T13:43:41.018346+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T13:43:43.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:43 smithi099 bash[9889]: cluster 2021-01-27T13:43:42.034786+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T13:43:43.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:43 smithi099 bash[9889]: audit 2021-01-27T13:43:42.045130+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? 172.21.15.37:0/3940333219' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:43.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:43 smithi037 bash[9724]: cluster 2021-01-27T13:43:42.034786+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T13:43:43.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:43 smithi037 bash[9724]: audit 2021-01-27T13:43:42.045130+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? 172.21.15.37:0/3940333219' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:43.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:43 smithi037 bash[13442]: cluster 2021-01-27T13:43:42.034786+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T13:43:43.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:43 smithi037 bash[13442]: audit 2021-01-27T13:43:42.045130+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? 172.21.15.37:0/3940333219' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:44.056 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_snap_rollback ... ok 2021-01-27T13:43:44.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:44 smithi099 bash[9889]: cluster 2021-01-27T13:43:42.382880+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v675: 212 pgs: 4 creating+peering, 11 unknown, 197 active+clean; 25 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T13:43:44.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:44 smithi099 bash[9889]: audit 2021-01-27T13:43:43.044457+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? 172.21.15.37:0/3940333219' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:44.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:44 smithi099 bash[9889]: cluster 2021-01-27T13:43:43.044614+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T13:43:44.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:44 smithi037 bash[9724]: cluster 2021-01-27T13:43:42.382880+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v675: 212 pgs: 4 creating+peering, 11 unknown, 197 active+clean; 25 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T13:43:44.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:44 smithi037 bash[9724]: audit 2021-01-27T13:43:43.044457+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? 172.21.15.37:0/3940333219' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:44.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:44 smithi037 bash[9724]: cluster 2021-01-27T13:43:43.044614+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T13:43:44.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:44 smithi037 bash[13442]: cluster 2021-01-27T13:43:42.382880+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v675: 212 pgs: 4 creating+peering, 11 unknown, 197 active+clean; 25 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-27T13:43:44.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:44 smithi037 bash[13442]: audit 2021-01-27T13:43:43.044457+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? 172.21.15.37:0/3940333219' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:44.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:44 smithi037 bash[13442]: cluster 2021-01-27T13:43:43.044614+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T13:43:45.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:45 smithi037 bash[9724]: cluster 2021-01-27T13:43:44.054293+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T13:43:45.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:45 smithi037 bash[13442]: cluster 2021-01-27T13:43:44.054293+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T13:43:45.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:45 smithi099 bash[9889]: cluster 2021-01-27T13:43:44.054293+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T13:43:46.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:46 smithi099 bash[9889]: cluster 2021-01-27T13:43:44.383623+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v678: 180 pgs: 180 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:46.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:46 smithi099 bash[9889]: cluster 2021-01-27T13:43:45.049431+0000 mon.a (mon.0) 1101 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:43:46.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:46 smithi099 bash[9889]: cluster 2021-01-27T13:43:45.049508+0000 mon.a (mon.0) 1102 : cluster [INF] Cluster is now healthy 2021-01-27T13:43:46.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:46 smithi099 bash[9889]: cluster 2021-01-27T13:43:45.071292+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T13:43:46.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:46 smithi037 bash[9724]: cluster 2021-01-27T13:43:44.383623+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v678: 180 pgs: 180 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:46.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:46 smithi037 bash[9724]: cluster 2021-01-27T13:43:45.049431+0000 mon.a (mon.0) 1101 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:43:46.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:46 smithi037 bash[9724]: cluster 2021-01-27T13:43:45.049508+0000 mon.a (mon.0) 1102 : cluster [INF] Cluster is now healthy 2021-01-27T13:43:46.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:46 smithi037 bash[9724]: cluster 2021-01-27T13:43:45.071292+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T13:43:46.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:46 smithi037 bash[13442]: cluster 2021-01-27T13:43:44.383623+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v678: 180 pgs: 180 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:46.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:46 smithi037 bash[13442]: cluster 2021-01-27T13:43:45.049431+0000 mon.a (mon.0) 1101 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T13:43:46.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:46 smithi037 bash[13442]: cluster 2021-01-27T13:43:45.049508+0000 mon.a (mon.0) 1102 : cluster [INF] Cluster is now healthy 2021-01-27T13:43:46.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:46 smithi037 bash[13442]: cluster 2021-01-27T13:43:45.071292+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T13:43:47.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:47 smithi099 bash[9889]: cluster 2021-01-27T13:43:46.070951+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T13:43:47.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:47 smithi099 bash[9889]: audit 2021-01-27T13:43:46.076139+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.37:0/119972748' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:47.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:47 smithi099 bash[9889]: audit 2021-01-27T13:43:46.083332+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:47.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:47 smithi037 bash[9724]: cluster 2021-01-27T13:43:46.070951+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T13:43:47.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:47 smithi037 bash[9724]: audit 2021-01-27T13:43:46.076139+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.37:0/119972748' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:47.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:47 smithi037 bash[9724]: audit 2021-01-27T13:43:46.083332+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:47.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:47 smithi037 bash[13442]: cluster 2021-01-27T13:43:46.070951+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T13:43:47.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:47 smithi037 bash[13442]: audit 2021-01-27T13:43:46.076139+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.37:0/119972748' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:47.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:47 smithi037 bash[13442]: audit 2021-01-27T13:43:46.083332+0000 mon.a (mon.0) 1105 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:48.120 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_snap_timestamp ... ok 2021-01-27T13:43:48.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:43:48 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:43:48.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:48 smithi099 bash[9889]: cluster 2021-01-27T13:43:46.384576+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v681: 212 pgs: 6 creating+peering, 25 unknown, 181 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:48.311 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:48 smithi099 bash[9889]: audit 2021-01-27T13:43:47.098482+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:48.312 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:48 smithi099 bash[9889]: cluster 2021-01-27T13:43:47.098659+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T13:43:48.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:48 smithi037 bash[9724]: cluster 2021-01-27T13:43:46.384576+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v681: 212 pgs: 6 creating+peering, 25 unknown, 181 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:48 smithi037 bash[9724]: audit 2021-01-27T13:43:47.098482+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:48 smithi037 bash[9724]: cluster 2021-01-27T13:43:47.098659+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T13:43:48.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:43:48 smithi037 bash[9955]: debug 2021-01-27T13:43:48.050+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:43:48.323 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:48 smithi037 bash[13442]: cluster 2021-01-27T13:43:46.384576+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v681: 212 pgs: 6 creating+peering, 25 unknown, 181 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:48.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:48 smithi037 bash[13442]: audit 2021-01-27T13:43:47.098482+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:48.324 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:48 smithi037 bash[13442]: cluster 2021-01-27T13:43:47.098659+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T13:43:49.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:49 smithi099 bash[9889]: audit 2021-01-27T13:43:48.057017+0000 mgr.y (mgr.14138) 618 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:49.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:49 smithi099 bash[9889]: cluster 2021-01-27T13:43:48.109203+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T13:43:49.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:49 smithi037 bash[9724]: audit 2021-01-27T13:43:48.057017+0000 mgr.y (mgr.14138) 618 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:49.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:49 smithi037 bash[9724]: cluster 2021-01-27T13:43:48.109203+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T13:43:49.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:49 smithi037 bash[13442]: audit 2021-01-27T13:43:48.057017+0000 mgr.y (mgr.14138) 618 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:49.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:49 smithi037 bash[13442]: cluster 2021-01-27T13:43:48.109203+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T13:43:50.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:50 smithi099 bash[9889]: cluster 2021-01-27T13:43:48.385697+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v684: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:50.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:50 smithi099 bash[9889]: cluster 2021-01-27T13:43:49.125402+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T13:43:50.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:50 smithi037 bash[9724]: cluster 2021-01-27T13:43:48.385697+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v684: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:50.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:50 smithi037 bash[9724]: cluster 2021-01-27T13:43:49.125402+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T13:43:50.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:50 smithi037 bash[13442]: cluster 2021-01-27T13:43:48.385697+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v684: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:50.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:50 smithi037 bash[13442]: cluster 2021-01-27T13:43:49.125402+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T13:43:51.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:51 smithi099 bash[9889]: cluster 2021-01-27T13:43:50.132755+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T13:43:51.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:51 smithi099 bash[9889]: audit 2021-01-27T13:43:50.170136+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.37:0/2819629615' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:51.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:51 smithi099 bash[9889]: audit 2021-01-27T13:43:50.170468+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:51.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:51 smithi037 bash[9724]: cluster 2021-01-27T13:43:50.132755+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T13:43:51.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:51 smithi037 bash[9724]: audit 2021-01-27T13:43:50.170136+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.37:0/2819629615' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:51.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:51 smithi037 bash[9724]: audit 2021-01-27T13:43:50.170468+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:51.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:51 smithi037 bash[13442]: cluster 2021-01-27T13:43:50.132755+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T13:43:51.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:51 smithi037 bash[13442]: audit 2021-01-27T13:43:50.170136+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.37:0/2819629615' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:51.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:51 smithi037 bash[13442]: audit 2021-01-27T13:43:50.170468+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:52.161 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_trunc ... ok 2021-01-27T13:43:52.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:52 smithi099 bash[9889]: cluster 2021-01-27T13:43:50.386860+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v687: 212 pgs: 7 creating+peering, 18 unknown, 187 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:52.666 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:52 smithi099 bash[9889]: audit 2021-01-27T13:43:51.150419+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:52.666 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:52 smithi099 bash[9889]: cluster 2021-01-27T13:43:51.150528+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2021-01-27T13:43:52.666 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:52 smithi099 bash[9889]: cluster 2021-01-27T13:43:52.157531+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2021-01-27T13:43:52.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:52 smithi037 bash[9724]: cluster 2021-01-27T13:43:50.386860+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v687: 212 pgs: 7 creating+peering, 18 unknown, 187 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:52.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:52 smithi037 bash[9724]: audit 2021-01-27T13:43:51.150419+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:52.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:52 smithi037 bash[9724]: cluster 2021-01-27T13:43:51.150528+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2021-01-27T13:43:52.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:52 smithi037 bash[9724]: cluster 2021-01-27T13:43:52.157531+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2021-01-27T13:43:52.668 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:52 smithi037 bash[13442]: cluster 2021-01-27T13:43:50.386860+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v687: 212 pgs: 7 creating+peering, 18 unknown, 187 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:52.669 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:52 smithi037 bash[13442]: audit 2021-01-27T13:43:51.150419+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:52.669 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:52 smithi037 bash[13442]: cluster 2021-01-27T13:43:51.150528+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2021-01-27T13:43:52.669 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:52 smithi037 bash[13442]: cluster 2021-01-27T13:43:52.157531+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2021-01-27T13:43:54.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:54 smithi099 bash[9889]: cluster 2021-01-27T13:43:52.387576+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v690: 180 pgs: 180 active+clean; 25 KiB data, 202 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:54.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:54 smithi099 bash[9889]: cluster 2021-01-27T13:43:53.182221+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2021-01-27T13:43:54.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:54 smithi037 bash[9724]: cluster 2021-01-27T13:43:52.387576+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v690: 180 pgs: 180 active+clean; 25 KiB data, 202 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:54.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:54 smithi037 bash[9724]: cluster 2021-01-27T13:43:53.182221+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2021-01-27T13:43:54.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:54 smithi037 bash[13442]: cluster 2021-01-27T13:43:52.387576+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v690: 180 pgs: 180 active+clean; 25 KiB data, 202 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:43:54.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:54 smithi037 bash[13442]: cluster 2021-01-27T13:43:53.182221+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2021-01-27T13:43:55.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:55 smithi099 bash[9889]: cluster 2021-01-27T13:43:54.188016+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-01-27T13:43:55.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:55 smithi099 bash[9889]: audit 2021-01-27T13:43:54.223018+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.37:0/1800526762' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:55.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:55 smithi099 bash[9889]: audit 2021-01-27T13:43:54.223510+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:55.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:55 smithi099 bash[9889]: cluster 2021-01-27T13:43:54.388596+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v693: 212 pgs: 14 creating+peering, 16 unknown, 182 active+clean; 25 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:55.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:55 smithi037 bash[9724]: cluster 2021-01-27T13:43:54.188016+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-01-27T13:43:55.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:55 smithi037 bash[9724]: audit 2021-01-27T13:43:54.223018+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.37:0/1800526762' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:55.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:55 smithi037 bash[9724]: audit 2021-01-27T13:43:54.223510+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:55.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:55 smithi037 bash[9724]: cluster 2021-01-27T13:43:54.388596+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v693: 212 pgs: 14 creating+peering, 16 unknown, 182 active+clean; 25 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:55.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:55 smithi037 bash[13442]: cluster 2021-01-27T13:43:54.188016+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-01-27T13:43:55.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:55 smithi037 bash[13442]: audit 2021-01-27T13:43:54.223018+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.37:0/1800526762' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:55.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:55 smithi037 bash[13442]: audit 2021-01-27T13:43:54.223510+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:55.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:55 smithi037 bash[13442]: cluster 2021-01-27T13:43:54.388596+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v693: 212 pgs: 14 creating+peering, 16 unknown, 182 active+clean; 25 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:56.234 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_write ... ok 2021-01-27T13:43:56.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:56 smithi099 bash[9889]: audit 2021-01-27T13:43:55.212744+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:56.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:56 smithi099 bash[9889]: cluster 2021-01-27T13:43:55.212999+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-01-27T13:43:56.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:56 smithi037 bash[9724]: audit 2021-01-27T13:43:55.212744+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:56.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:56 smithi037 bash[9724]: cluster 2021-01-27T13:43:55.212999+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-01-27T13:43:56.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:56 smithi037 bash[13442]: audit 2021-01-27T13:43:55.212744+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:43:56.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:56 smithi037 bash[13442]: cluster 2021-01-27T13:43:55.212999+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-01-27T13:43:57.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:57 smithi099 bash[9889]: cluster 2021-01-27T13:43:56.226274+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-01-27T13:43:57.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:57 smithi099 bash[9889]: cluster 2021-01-27T13:43:56.389499+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v696: 180 pgs: 180 active+clean; 25 KiB data, 188 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:57.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:57 smithi037 bash[9724]: cluster 2021-01-27T13:43:56.226274+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-01-27T13:43:57.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:57 smithi037 bash[9724]: cluster 2021-01-27T13:43:56.389499+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v696: 180 pgs: 180 active+clean; 25 KiB data, 188 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:57.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:57 smithi037 bash[13442]: cluster 2021-01-27T13:43:56.226274+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-01-27T13:43:57.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:57 smithi037 bash[13442]: cluster 2021-01-27T13:43:56.389499+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v696: 180 pgs: 180 active+clean; 25 KiB data, 188 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:58.323 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:43:58 smithi037 bash[9955]: debug 2021-01-27T13:43:58.061+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:43:58.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:58 smithi037 bash[9724]: cluster 2021-01-27T13:43:57.240353+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-01-27T13:43:58.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:58 smithi037 bash[9724]: audit 2021-01-27T13:43:58.067821+0000 mgr.y (mgr.14138) 624 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:58.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:58 smithi037 bash[13442]: cluster 2021-01-27T13:43:57.240353+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-01-27T13:43:58.325 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:58 smithi037 bash[13442]: audit 2021-01-27T13:43:58.067821+0000 mgr.y (mgr.14138) 624 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:58.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:58 smithi099 bash[9889]: cluster 2021-01-27T13:43:57.240353+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-01-27T13:43:58.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:58 smithi099 bash[9889]: audit 2021-01-27T13:43:58.067821+0000 mgr.y (mgr.14138) 624 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:43:58.563 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:43:58 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:43:59.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:59 smithi099 bash[9889]: cluster 2021-01-27T13:43:58.244009+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-01-27T13:43:59.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:59 smithi099 bash[9889]: audit 2021-01-27T13:43:58.283812+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.37:0/3189192308' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:59.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:43:59 smithi099 bash[9889]: cluster 2021-01-27T13:43:58.390736+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v699: 212 pgs: 1 creating+activating, 22 unknown, 189 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:59.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:59 smithi037 bash[9724]: cluster 2021-01-27T13:43:58.244009+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-01-27T13:43:59.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:59 smithi037 bash[9724]: audit 2021-01-27T13:43:58.283812+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.37:0/3189192308' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:59.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:43:59 smithi037 bash[9724]: cluster 2021-01-27T13:43:58.390736+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v699: 212 pgs: 1 creating+activating, 22 unknown, 189 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:43:59.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:59 smithi037 bash[13442]: cluster 2021-01-27T13:43:58.244009+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-01-27T13:43:59.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:59 smithi037 bash[13442]: audit 2021-01-27T13:43:58.283812+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? 172.21.15.37:0/3189192308' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:43:59.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:43:59 smithi037 bash[13442]: cluster 2021-01-27T13:43:58.390736+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v699: 212 pgs: 1 creating+activating, 22 unknown, 189 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:00.279 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_write_full ... ok 2021-01-27T13:44:00.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:00 smithi099 bash[9889]: audit 2021-01-27T13:43:59.271652+0000 mon.a (mon.0) 1124 : audit [INF] from='client.? 172.21.15.37:0/3189192308' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:00.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:00 smithi099 bash[9889]: cluster 2021-01-27T13:43:59.271774+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2021-01-27T13:44:00.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:00 smithi037 bash[9724]: audit 2021-01-27T13:43:59.271652+0000 mon.a (mon.0) 1124 : audit [INF] from='client.? 172.21.15.37:0/3189192308' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:00.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:00 smithi037 bash[9724]: cluster 2021-01-27T13:43:59.271774+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2021-01-27T13:44:00.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:00 smithi037 bash[13442]: audit 2021-01-27T13:43:59.271652+0000 mon.a (mon.0) 1124 : audit [INF] from='client.? 172.21.15.37:0/3189192308' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:00.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:00 smithi037 bash[13442]: cluster 2021-01-27T13:43:59.271774+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2021-01-27T13:44:01.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:01 smithi099 bash[9889]: cluster 2021-01-27T13:44:00.276015+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2021-01-27T13:44:01.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:01 smithi099 bash[9889]: cluster 2021-01-27T13:44:00.391778+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v702: 180 pgs: 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:01.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:01 smithi037 bash[13442]: cluster 2021-01-27T13:44:00.276015+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2021-01-27T13:44:01.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:01 smithi037 bash[13442]: cluster 2021-01-27T13:44:00.391778+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v702: 180 pgs: 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:01.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:01 smithi037 bash[9724]: cluster 2021-01-27T13:44:00.276015+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2021-01-27T13:44:01.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:01 smithi037 bash[9724]: cluster 2021-01-27T13:44:00.391778+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v702: 180 pgs: 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:02.572 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:02 smithi037 bash[13442]: cluster 2021-01-27T13:44:01.300530+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2021-01-27T13:44:02.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:02 smithi037 bash[9724]: cluster 2021-01-27T13:44:01.300530+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2021-01-27T13:44:02.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:02 smithi099 bash[9889]: cluster 2021-01-27T13:44:01.300530+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2021-01-27T13:44:03.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:03 smithi037 bash[9724]: cluster 2021-01-27T13:44:02.305312+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2021-01-27T13:44:03.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:03 smithi037 bash[9724]: audit 2021-01-27T13:44:02.354907+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.37:0/3732446620' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:44:03.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:03 smithi037 bash[9724]: cluster 2021-01-27T13:44:02.392558+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v705: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:44:03.573 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:03 smithi037 bash[13442]: cluster 2021-01-27T13:44:02.305312+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2021-01-27T13:44:03.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:03 smithi037 bash[13442]: audit 2021-01-27T13:44:02.354907+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.37:0/3732446620' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:44:03.574 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:03 smithi037 bash[13442]: cluster 2021-01-27T13:44:02.392558+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v705: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:44:03.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:03 smithi099 bash[9889]: cluster 2021-01-27T13:44:02.305312+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2021-01-27T13:44:03.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:03 smithi099 bash[9889]: audit 2021-01-27T13:44:02.354907+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.37:0/3732446620' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:44:03.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:03 smithi099 bash[9889]: cluster 2021-01-27T13:44:02.392558+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v705: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail 2021-01-27T13:44:04.342 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_write_ops ... ok 2021-01-27T13:44:04.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:04 smithi099 bash[9889]: audit 2021-01-27T13:44:03.332638+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? 172.21.15.37:0/3732446620' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:04.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:04 smithi099 bash[9889]: cluster 2021-01-27T13:44:03.332758+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2021-01-27T13:44:04.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:04 smithi037 bash[13442]: audit 2021-01-27T13:44:03.332638+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? 172.21.15.37:0/3732446620' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:04.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:04 smithi037 bash[13442]: cluster 2021-01-27T13:44:03.332758+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2021-01-27T13:44:04.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:04 smithi037 bash[9724]: audit 2021-01-27T13:44:03.332638+0000 mon.a (mon.0) 1130 : audit [INF] from='client.? 172.21.15.37:0/3732446620' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:04.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:04 smithi037 bash[9724]: cluster 2021-01-27T13:44:03.332758+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2021-01-27T13:44:05.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:05 smithi099 bash[9889]: cluster 2021-01-27T13:44:04.340028+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2021-01-27T13:44:05.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:05 smithi099 bash[9889]: cluster 2021-01-27T13:44:04.393228+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v708: 180 pgs: 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:05.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:05 smithi037 bash[9724]: cluster 2021-01-27T13:44:04.340028+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2021-01-27T13:44:05.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:05 smithi037 bash[9724]: cluster 2021-01-27T13:44:04.393228+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v708: 180 pgs: 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:05.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:05 smithi037 bash[13442]: cluster 2021-01-27T13:44:04.340028+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2021-01-27T13:44:05.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:05 smithi037 bash[13442]: cluster 2021-01-27T13:44:04.393228+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v708: 180 pgs: 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:06.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:06 smithi099 bash[9889]: cluster 2021-01-27T13:44:05.366476+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2021-01-27T13:44:06.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:06 smithi037 bash[9724]: cluster 2021-01-27T13:44:05.366476+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2021-01-27T13:44:06.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:06 smithi037 bash[13442]: cluster 2021-01-27T13:44:05.366476+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2021-01-27T13:44:07.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:07 smithi099 bash[9889]: cluster 2021-01-27T13:44:06.369300+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2021-01-27T13:44:07.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:07 smithi099 bash[9889]: cluster 2021-01-27T13:44:06.393855+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v711: 212 pgs: 1 creating+peering, 31 unknown, 180 active+clean; 25 KiB data, 144 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:07.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:07 smithi099 bash[9889]: audit 2021-01-27T13:44:06.404670+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? 172.21.15.37:0/379154439' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:44:07.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:07 smithi037 bash[13442]: cluster 2021-01-27T13:44:06.369300+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2021-01-27T13:44:07.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:07 smithi037 bash[13442]: cluster 2021-01-27T13:44:06.393855+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v711: 212 pgs: 1 creating+peering, 31 unknown, 180 active+clean; 25 KiB data, 144 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:07.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:07 smithi037 bash[13442]: audit 2021-01-27T13:44:06.404670+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? 172.21.15.37:0/379154439' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:44:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:07 smithi037 bash[9724]: cluster 2021-01-27T13:44:06.369300+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2021-01-27T13:44:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:07 smithi037 bash[9724]: cluster 2021-01-27T13:44:06.393855+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v711: 212 pgs: 1 creating+peering, 31 unknown, 180 active+clean; 25 KiB data, 144 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:07 smithi037 bash[9724]: audit 2021-01-27T13:44:06.404670+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? 172.21.15.37:0/379154439' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:44:08.408 INFO:tasks.workunit.client.0.smithi037.stderr:test_rados.TestIoctx.test_write_zeros ... ok 2021-01-27T13:44:08.408 INFO:journalctl@ceph.mgr.y.smithi037.stdout:Jan 27 13:44:08 smithi037 bash[9955]: debug 2021-01-27T13:44:08.069+0000 7f44267f4700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T13:44:08.409 INFO:journalctl@ceph.iscsi.iscsi.a.smithi099.stdout:Jan 27 13:44:08 smithi099 bash[22239]: debug mgr command failed -13 2021-01-27T13:44:08.409 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:08 smithi037 bash[13442]: audit 2021-01-27T13:44:07.397279+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? 172.21.15.37:0/379154439' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:08.410 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:08 smithi037 bash[9724]: audit 2021-01-27T13:44:07.397279+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? 172.21.15.37:0/379154439' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:08.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:08 smithi099 bash[9889]: audit 2021-01-27T13:44:07.397279+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? 172.21.15.37:0/379154439' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T13:44:08.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:08 smithi099 bash[9889]: cluster 2021-01-27T13:44:07.397507+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2021-01-27T13:44:08.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:08 smithi099 bash[9889]: audit 2021-01-27T13:44:08.075848+0000 mgr.y (mgr.14138) 630 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:44:08.822 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:08 smithi037 bash[13442]: cluster 2021-01-27T13:44:07.397507+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2021-01-27T13:44:08.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:08 smithi037 bash[13442]: audit 2021-01-27T13:44:08.075848+0000 mgr.y (mgr.14138) 630 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:44:08.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:08 smithi037 bash[9724]: cluster 2021-01-27T13:44:07.397507+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2021-01-27T13:44:08.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:08 smithi037 bash[9724]: audit 2021-01-27T13:44:08.075848+0000 mgr.y (mgr.14138) 630 : audit [INF] from='client.34469 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T13:44:09.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:09 smithi099 bash[9889]: cluster 2021-01-27T13:44:08.395176+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v713: 212 pgs: 1 creating+peering, 8 unknown, 203 active+clean; 25 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 252 B/s wr, 1 op/s 2021-01-27T13:44:09.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:09 smithi099 bash[9889]: cluster 2021-01-27T13:44:08.399889+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2021-01-27T13:44:09.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:09 smithi037 bash[9724]: cluster 2021-01-27T13:44:08.395176+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v713: 212 pgs: 1 creating+peering, 8 unknown, 203 active+clean; 25 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 252 B/s wr, 1 op/s 2021-01-27T13:44:09.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:09 smithi037 bash[9724]: cluster 2021-01-27T13:44:08.399889+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2021-01-27T13:44:09.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:09 smithi037 bash[13442]: cluster 2021-01-27T13:44:08.395176+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v713: 212 pgs: 1 creating+peering, 8 unknown, 203 active+clean; 25 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 252 B/s wr, 1 op/s 2021-01-27T13:44:09.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:09 smithi037 bash[13442]: cluster 2021-01-27T13:44:08.399889+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2021-01-27T13:44:10.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:10 smithi099 bash[9889]: cluster 2021-01-27T13:44:09.423883+0000 mon.a (mon.0) 1139 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2021-01-27T13:44:10.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:10 smithi037 bash[9724]: cluster 2021-01-27T13:44:09.423883+0000 mon.a (mon.0) 1139 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2021-01-27T13:44:10.821 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:10 smithi037 bash[13442]: cluster 2021-01-27T13:44:09.423883+0000 mon.a (mon.0) 1139 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2021-01-27T13:44:11.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:11 smithi099 bash[9889]: cluster 2021-01-27T13:44:10.396789+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v716: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:11.811 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:11 smithi099 bash[9889]: cluster 2021-01-27T13:44:10.429815+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2021-01-27T13:44:11.812 INFO:journalctl@ceph.mon.b.smithi099.stdout:Jan 27 13:44:11 smithi099 bash[9889]: audit 2021-01-27T13:44:10.460805+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? 172.21.15.37:0/2453217573' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:44:11.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:11 smithi037 bash[9724]: cluster 2021-01-27T13:44:10.396789+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v716: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:11.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:11 smithi037 bash[9724]: cluster 2021-01-27T13:44:10.429815+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2021-01-27T13:44:11.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Jan 27 13:44:11 smithi037 bash[9724]: audit 2021-01-27T13:44:10.460805+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? 172.21.15.37:0/2453217573' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T13:44:11.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:11 smithi037 bash[13442]: cluster 2021-01-27T13:44:10.396789+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v716: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 145 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T13:44:11.823 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:11 smithi037 bash[13442]: cluster 2021-01-27T13:44:10.429815+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2021-01-27T13:44:11.824 INFO:journalctl@ceph.mon.c.smithi037.stdout:Jan 27 13:44:11 smithi037 bash[13442]: audit 2021-01-27T13:44:10.460805+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? 172.21.15.37:0/2453217573' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T01:15:07.144 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-01-28T01:15:07.174 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2021-01-28T01:15:07.176 DEBUG:teuthology.task.console_log:Killing console logger for smithi099 2021-01-28T01:15:07.176 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2021-01-28T01:15:07.176 DEBUG:teuthology.task.console_log:Killing console logger for smithi099 2021-01-28T01:15:07.177 DEBUG:teuthology.exit:Finished running handlers